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Numerical  Methods  in  Aerospace  Systems  Theory  ’ 

by 

ANGELO  MIELE3 

Abstract.  This  document  summarizes  the  research  performed  at  Rice  University 
during  the  period  1971-76  under  Air  Force  Grant  No.  AF-AFOSR-72-2185  in 
several  areas  of  numerical  analysis  of  interest  in  aerospace  systems  theory, 
namely:  (i)  solution  of  nonlinear  equations,  (ii)  solution  of  differential 
equations,  (iii)  mathematical  programming  problems,  and  (iv)  optimal  control 
problems.  The  work  summarized  here  is  eminently  applicable  to  these  areas 
of  aerospace  engineering:  (i)  optimum  atmospheric  flight  trajectories, 

(ii)  optimum  extra-atmospheric  flight  trajectories,  (iii)  optimum  aerody- 
namic shapes,  and  (iv)  optimum  structures.  ^ 

Key  Words.  Numerical  analysis,  numerical  methods,  computing  methods,  com- 
puting techniques. 

Differential  equations,  stiff  differential  equations,  two-point 
boundary-value  problems,  multipoint  boundary-value  problems. 

Method  of  particular  solutions,  quasilinearization  algorithm,  modified 
quasilinearization  algorithm,  restoration  algorithm. 

Gradient  algorithm,  conjugate  gradient  algorithm,  sequential  gradient- 

1 Period  October  1,  1971  through  August  31  , 1976. 

2This  research  was  supported  by  the  Office  of  Scientific  Research,  Office 
of  Aerospace  Research,  United  States  Air  Force,  Grant  No.  AF-AFOSR-72-2185. 

3Professor  of  Astronautics  and  Mathematical  Sciences,  Rice  University, 
Houston,  Texas. 
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restoration  algorithm,  sequential  conjugate  gradient-restoration  algorithm. 

Optimal  control,  calculus  of  variations,  differential  constraints, 
nondifferential  constraints,  bounded  state,  bounded  control,  bounded  time 
rate  of  change  of  the  state,  free  initial  state,  transformation  techniques. 

Aerospace  engineering,  optimum  atmospheric  flight  trajectories,  op- 
timum extra-atmospheric  flight  trajectories,  optimum  aerodynamic  shapes, 
optimum  structures. 
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Introduction 


This  ducument  summarizes  the  research  performed  at  Rice  University 
in  the  period  1971-76  under  Air  Force  Grant  No.  AF-AFOSR-72-2185.  The 
total  duration  of  the  grant  was  59  months.  The  grant  was  successively 


monitored  by  It.  Col.  N.  P.  Callas,  Dr. 
Ramirez. 

R.  G.  Pohrer,  and  Lt.  Col. 

The  personnel  participating  in  the 
lowing  people: 

Faculty  Personnel 

research  effort  included 

Prof.  A.  Miele 

Prof.  H.  Y.  Huang 

Senior  Personnel 

Dr.  J.  N.  Damoulakis 

Dr.  A.  Mangiavacchi 

Dr.  J.  C.  Heideman 
Dr.  A.  V.  Levy 

Major  G.  R.  Hennig,  USAF 

Junior  Personnel 

Mr.  A.  K.  Aggarwal 

Mr.  S.  Naqvi 

Mr.  J.  R.  Cloutier 

Mr.  J.  L.  Tietze 

Mr.  A.  Esterle 

Mr.  K.  H.  Well 

Mr.  A.  V.  Levy 
Mr.  B.  P.  Mohanty 

Mr.  A.  K.  Wu 

As  a partial  result  of  research  performed  under  this  grant, 
following  advanced  degrees  were  awarded: 

MS  Degrees 

A.  K.  Aggarwal 

S.  Naqvi 

0.  R.  Cloutier 

A.  K.  Wu 

PhD  Degrees 

A.  K.  Aggarwal 

S.  Naqvi 

J.  R.  Cloutier 

J.  L.  Tietze 

A.  V.  Levy 

K.  H.  Well 
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II.  Research  Achievements 

The  research  undertaken  under  Grant  No.  AF-AFOSR-72-2185  over  the 
past  five  years  has  spanned  several  areas  of  numerical  analysis,  namely: 

(i)  solution  of  nonlinear  equations,  (ii)  solution  of  differential  equa- 
tions, (iii)  mathematical  programming  problems,  and  (iv)  optimal  control 
problems.  The  principal  results  of  this  effort,  summarized  in  26  reports 
and  17  journal  articles  are  described  below. 

(a)  Development  of  techniques  to  handle  two-point  boundary-value 
problems  characterized  by  stiff  differential  equations  (Refs. 11 ,12,22  and 
Refs. 30, 36). 

(b)  Comparison  of  several  gradient  algorithms  for  mathematical  pro- 
gramming problems  (Refs. 2 and  37). 

(c)  Comparison  of  several  gradient  algorithms  for  optimal  control 
problems  (Refs. 3 and  27). 

(d)  Development  of  the  sequential  gradient-restoration  algorithm 
and  the  combined  gradient  restoration  algorithm  for  optimal  control  pro- 
blems (Refs. 1,4, 25  and  Refs. 28, 43). 

(e)  Sequential  gradient-restoration  algorithm  for  optimal  control 
problems  with  bounded  state  (Refs. 5,6,10  and  Refs. 31 ,33). 

(f)  Modified  quasilinearization  algorithm  for  optimal  control  problems 
with  bounded  state  (Refs. 7, 9, 10  and  Refs. 32-33). 

(g)  Unconstrained  approach  to  the  extremization  of  terminally  con- 
strained optimal  control  problems  (Refs. 8 and  29). 

(h)  Sequential  gradient-restoration  algorithm  for  optimal  control 
problems  with  nondifferential  constraints  (Refs. 13-15  and  34). 

(1)  Modified  quasil inearization  algorithm  for  optimal  control  problems 
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with  nondifferential  constraints  (Refs. 16-17  and  35). 

(j)  Sequential  conjugate  gradient-restoration  algorithm  for  optimal 
control  problems  (Refs. 20-21  and  Refs. 38-39). 

(k)  Hybrid  approach  to  optimal  control  problems  with  bounded  state 
(Refs. 18-19  and  40). 

(l)  New  transformation  technique  for  optimal  control  problems  with 
bounded  state  (Refs. 23-24  and  Refs. 41-42). 

(m)  Conversion  of  optimal  control  problems  with  free  initial  state 
into  optimal  control  problems  with  fixed  initial  state  (Ref. 26). 

(n)  Survey  of  the  present  state  of  the  art  in  gradient  algorithms 
for  optimal  control  problems  (Refs. 25  and  43). 

A list  of  research  reports  is  given  in  Section  VI,  and  a list  of 
the  research  papers  is  given  In  Section  VII.  Then,  the  abstracts  of  the 
reports  are  given  in  Section  VIII,  and  the  abstracts  of  the  papers  are 
given  in  Section  IX. 
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III.  Areas  of  Application 

Attention  of  USAF  technical  personnel  is  railed  on  the  fact  that  the 
research  summarized  in  Refs. 1-43  is  not  the  result  of  an  abstract  mathe- 
matical formulation,  but  rather  the  result  of  concrete  problems  of  applied 
mathematics  arising  in  several  areas  of  aerospace  engineering,  namely: 

(i)  optimum  atmospheric  flight  trajectories,  (ii)  optimum  extra-atmospheric 
flight  trajectories,  (iii)  optimum  aerodynamic  shapes,  and  (iv)  optimum 
structures.  For  particular  examples  illustrating  (i)  and  (iv)  see  the 

next  section.  For  general  examples  illustrating  (i)  and  (iii),  consult 

4 5 

the  books  listed  below.  ’ 


4 Miele,  A.,  Flight  Mechanics,  Vol.l,  Addison-Wesley  Publishing  Company, 
Reading,  Massachusetts,  1962. 

^ Miele,  A.,  Editor,  Theory  of  Optimum  Aerodynamic  Shapes,  Academic  Press, 
New  York,  New  York,  1965. 
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IV.  Collaboration  with  Air  Force  Personnel 

As  a result  of  seminars  given  by  the  principal  investigator  at  the 
USAF  Academy,  Colorado,  and  at  Wright-Patterson  Air  Force  Base,  Ohio,  a 
collaboration  has  been  undertaken  with  Major  G.  R.  Hennig  (USAFA  and  WPAFB) 
and  with  Dr.  V.  B.  Venkayya  (WPAFB). 

Directly,  the  collaboration  with  Major  G.  R.  Hennig  has  resulted  in 
the  development  of  the  sequential  gradient-restoration  algorithm  for  op- 
timal control  problems  with  bounded  state  (Hennig  and  Miele,  Refs. 5-6  and 
Ref. 31).  Indirectly,  the  collaboration  with  Major  Hennig  has  lead  to  a 
paper  by  Major  Hennig  and  his  associates  on  optimum  flight  trajectories  in 
a three-dimensional  space.6  In  this  paper,  the  methodology  of  the  sequen- 
tial gradient-restoration  algorithm  has  been  employed  to  optimize  turning 
manoeuvers  for  turbojet-powered  aircraft. 

More  recently,  the  collaboration  with  Dr.  V.  B.  Venkayya  has  led  to 
the  employment  of  the  sequential  gradient-restoration  algorithm  in  some 
problems  of  structural  analysis.7  It  is  anticipated  that  this  preliminary 
effort  will  lead  to  further  collaboration  and  to  subsequent  research  on 
optimum  structures. 


6 Humphrey,  R.P.,  Hennig,  G.R.,  Bolding,  W.A.,  and  Hegelson,  L.A.,  Optimum 
Three-Dimensional  Minimum  Time  Turns  for  an  Aircraft,  Journal  of  the  Astro- 
nautical  Sciences,  Vol.20,  No. 2,  1972. 

7 Miele,  A.,  Numerical  Determination  of  Minimum  Mass  Structures  with  Specified 
Natural  Frequencies,  Rice  University,  Internal  Memorandum,  1976. 
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Research  in  Progress 

At  this  time,  considerable  research  is  in  progress  on  (i)  the  de- 
velopment of  the  sequential  conjugate  gradient-restoration  algorithm  for 
optimal  control  problems  involving  nondifferential  constraints  and  (ii)  the 
study  of  transformation  techniques  for  optimal  control  problems9.  Com- 
pletion of  this  research  does  not  seem  possible  within  the  time  limits  of 
the  current  grant.  However,  completion  is  expected  before  the  end  of  this 
calendar  year  and  will  take  place  within  the  limits  of  a subsequent  grant 
being  negotiated  at  this  time. 


8 Cloutier,  J.R.,  Mohanty,  B.P.,  and  Miele,  A.,  Sequential  Conjugate  Gra 
dient-Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondif- 
ferential Constraints,  Rice  University,  Internal  Memorandum,  1976. 

9 Miele,  A.,  Transformation  Techniques  for  Optimal  Control  Problems,  Rice 
University,  Internal  Memorandum,  1976. 
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V I . Reports  of  the  Aero-Astronautics  Group 

1.  MIELE,  A.,  Combined  Gradient-Restoration  Algorithm  for  Optimal  Control 
Problems,  Rice  University,  Aero-Astronautics  Report  No. 91,  1971. 

2.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Comparison  of  Several  Gra- 
dient Algorithms  for  Mathematical  Programming  Problems,  Rice  University, 
Aero-Astronautics  Report  No. 94,  1972. 

3.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Comparison  of  Several  Gra- 
dient Algorithms  for  Optimal  Control  Problems,  Rice  University,  Aero- 
Astronautics  Report  No. 95,  1972. 

4.  MIELE,  A.,  Gradient  Methods  in  Optimal  Control  Theory,  Rice  University, 
Aero-Astronautics  Report  No. 98,  1971. 

5.  HENNIG,  G.  R. , and  MIELE,  A.,  Sequential  Gradient-Restoration  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part  1, 

Theory,  Rice  University,  Aero-Astronautics  Report  No. 101,  1972. 

6.  HENNIG,  G.  R.,  and  MIELE,  A.,  Sequential  Gradient-Restoration  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part  2 , 
Examples,  Rice  University,  Aero-Astronautics  Report  No. 102,  1972. 

7.  MIELE,  A.,  WELL,  K.  H. , and  TIETZE,  J.  L.,  Modified  Quasilinearization 
Algorithm  for  Optimal  Control  Problems  with  Bounded  State  Variables, 

Part  1,  Theory,  Rice  University,  Aero-Astronautics  Report  No. 103,  1972. 

8.  HUANG,  H.  Y.,  and  NAQVI,  S.,  Extremization  of  Terminally  Constrained 
Control  Problems,  Rice  University,  Aero-Astronautics  Report  No. 104,  1972. 

9.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.,  Modified  Quasi  linearization 
Algorithm  for  Optimal  Control  Problems  with  Bounded  State  Variables, 

Part  2,  Examples,  Rice  University,  Aero-Astronautics  Report  No. 105,  1972. 
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10.  HUANG,  H.  Y. , and  ESTERLE,  A , Some  Properties  of  the  Sequential  Gra- 
dient-Restoration Algorithm  and  the  Modified  Quasi  1 inearization  Algo- 
rithm for  Optimal  Control  Problems  with  Bounded  State.  Rice  University, 
Aero-Astronautics  Report  No. 106,  1972. 

11.  MIELE,  A.,  AGGARWAL,  A.  K. , and  TIETZE,  J.  L.,  Solution  of  a Two-Point 
Boundary-Value  Problem  with  Jacobian  Matrix  Characterized  by  Extremely 
Large  Eigenvalues,  Rice  University,  Aero-Astronautics  Report  No. 107,  1972. 

12.  MIELE,  A.,  WELL,  K.  H. , and  TIETZE,  J.  L.,  Multipoint  Approach  to  the 
Two-Point  Boundary-Value  Problem,  Rice  University,  Aero-Astronautics 
Report  .<0.108,  1972. 

13.  MIELE,  A.,  DAMOULAKIS,  J.  N.,  and  CLOUTIER,  J.  R. , Sequential  Gradient- 
Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  1,  Theory,  Rice  University,  Aero-Astronautics  Re- 
port No. 109,  1973. 

14.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.  R.,  Sequential  Gradient- 
Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  2,  Examples,  Rice  University,  Aero-Astronautics  Re- 
port No. 110,  1973. 

15.  MIELE,  A., DAMOULAKIS,  J.  N.,  and  TIETZE,  J.  L.,  Sequential  Gradient- 
Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  3,  Examples,  Rice  University,  Aero-Astronautics 
Report  No. Ill , 1973. 

16.  MIELE,  A.,  MANGIAVACCHI , A.,  and  AGGARWAL,  A.  K. , Modified  Quasilineari- 
zation Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  1,  Theory,  Rice  University,  Aero-Astronautics  Report 


No. 112,  1973. 
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17.  MIELE,  A.,  MANGIAVACCHI,  A.,  and  AGGARWAL,  A.  K. , Modified  Quasi  - 
linearization  Algorithm  for  Optimal  Control  Problems  with  Nondiffe- 
rential Constraints,  Part  2,  Examples,  Rice  University,  Aero-Astro- 
nautics  Report  No. 113,  1973. 

18.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.  R.,  A Hybrid  Approach  to 
Optimal  Control  Problems  with  Bounded  State,  Part  1,  Theory,  Rice 
University,  Aero-Astronautics  Report  No. 114,1974. 

19.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.  R.,  A Hybrid  Approach  to 
Optimal  Control  Problems  with  Bounded  State,  Part  2,  Examples,  Rice 
University,  Aero-Astronautics  Report  No. 115,  1974. 

20.  HE I DEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Resto- 
ration Algorithm  for  Optimal  Control  Problems,  Part  1,  Theory,  Rice 
University,  Aero-Astronautics  Report  No. 116,  1974. 

21.  HEIDEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Resto- 
ration Algorithm  for  Optimal  Control  Problems,  Part  2,  Examples, 

Rice  University,  Aero-Astronautics  Report  No. 117,  1974. 

22.  AGGARWAL,  A.  K. , Some  Numerical  Results  on  Holt's  Two-Point  Boundary- 
Value  Problem,  Rice  University,  Aero-Astronautics  Report  No. 118,  1973. 

23.  MIELE,  A.,  and  CLOUTIER,  J.  R.,  New  Transformation  Technique  for  Optimal 
Control  Problems  with  Bounded  State,  Part  1,  Theory,  Rice  University, 
Aero-Astronautics  Report  No. 122,  1974. 

24.  MIELE,  A.,  and  CLOUTIER,  J.  R.,  New  Transformation  Technique  for  Optimal 
Control  Problems  with  Bounded  State,  Part  2,  Examples,  Rice  University, 
Aero-Astronautics  Report  No. 123,  1974. 

25.  MIELE,  A.,  Recent  Advances  in  Gradient  Algorithms  for  Optimal  Control 
Problems,  Rice  University,  Aero-Astronautics  Report  No. 129,  1975. 
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VIII.  Abstracts  of  Reports 

1.  MIELE,  A.,  Combined  Gradient-Restoration  Algorithm  for  Optimal  Control 
Problems,  Rice  University,  Aero-Astronautics  Report  No. 91,  1971. 

Abstract.  This  paper  considers  the  problem  of  minimizing  a functional  I 
which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  it. 

Here,  I is  a scalar,  x an  n-vector,  u an  m-vector,  and  it  a p-vector.  At 
the  initial  point,  the  state  is  prescribed.  At  the  final  point,  the  state 
and  the  parameter  are  required  to  satisfy  q scalar  relations.  Along  the 
interval  of  integration,  the  state,  the  control,  and  the  parameter  are 
required  to  satisfy  n scalar  differential  equations.  A combined  gradient- 
restoration  algorithm  is  presented:  this  is  an  iterative  algorithm  charac- 
terized by  variations  Ax(t),  Au(t),  An  leading  toward  the  optimality  condition 
while  simultaneously  leading  toward  constraint  satisfaction. 

The  variations  Ax(t),  Au(t),  An  are  generated  by  requiring  the  first 
variations  of  the  augmented  functional  J and  the  constraint  error  P to  be 
negative.  The  procedure  leads  to  a linear,  two-point  boundary-value  prob- 
lem, which  is  solved  via  the  method  of  particular  solutions.  The  descent 
properties  of  the  algorithm  are  studied,  and  schemes  to  determine  the  op- 
timum stepsize  are  discussed. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  gradient 
algorithm,  gradient-restoration  algorithm,  combined  gradient-restoration 
algorithm. 
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2.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Comparison  of  Several  Gradient 
Algorithms  for  Mathematical  Programming  Problems,  Rice  University,  Aero- 
Astronautics  Report  No. 94,  1972. 


Abstract.  In  this  paper,  the  numerical  solution  of  the  basic  problem  of 
mathematical  programming  is  considered.  This  is  the  problem  of  minimizing 
a function  f(x)  subject  to  a constraint  $(x)  = 0.  Here,  f is  a scalar, 
x an  n-vector,  and  4>  a q-vector,  with  q < n. 

Six  variations  of  the  sequential  gradient-restoration  algorithm  and 
the  combined  gradient-restoration  algorithm  are  considered,  and  their  rela- 
tive efficiency  (in  terms  of  number  of  iterations  for  convergence)  is 
evaluated.  The  variations  being  considered  are  as  follows: 

(i)  SGRA-CR,  sequential  gradient-restoration  algorithm,  complete  restoration, 

(ii)  SGRA-IR,  sequential  gradient-restoration  algorithm,  incomplete  restoration, 

(iii)  SGRA-OR,  sequential  gradient-restoration  algorithm,  optional  restoration, 

(iv)  CGRA-NR,  combined  gradient-restoration  algorithm,  no  restoration, 

(v)  CGRA-AR,  combined  gradient-restoration  algorithm,  alternate  restoration, 

(vi)  CGRA-GR,  combined  gradient-restoration  algorithm,  optional  restoration. 

Evaluation  of  these  algorithms  is  accomplished  through  eight  numerical 
examples.  The  first  two  examples  pertain  to  quadratic  functions  subject  to 
linear  constraints.  The  remaining  examples  pertain  to  nonquadratic  func- 
tions subject  to  nonlinear  constraints.  The  results  indicate  that  (a)  the 
Inclusion  of  a restoration  phase  Is  necessary  for  rapid  convergence  and 
(b)  the  algorithms  with  alternate  restoration  or  optional  restoration  are 
the  most  efficient  among  those  considered  here. 

Key  Words.  Mathematical  programming,  numerical  methods,  computing  methods, 
gradient  algorithm,  restoration  algorithm,  gradient-restoration  algorithm. 
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3.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Comparison  of  Several  Gradient 
Algorithms  for  Optimal  Control  Problems.  Rice  University,  Aero-Astronautics 
Report  No. 95,  1972. 

Abstract.  This  paper  considers  the  problem  of  minimizing  a functional  I which 
depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  . Here,  I 
is  a scalar,  x an  n-vector,  u an  m-vector,  and  n a p-vector.  At  the  initial 
point,  the  state  is  prescribed.  At  the  final  point,  the  state  and  the  para- 
meter are  required  to  satisfy  q scalar  relations.  Along  the  interval  of 
integration,  the  state,  the  control,  and  the  parameter  are  required  to 
satisfy  n scalar  differential  equations. 

Four  variations  of  the  sequential  gradient-restoration  algorithm  and 
the  combined  gradient-restoration  algorithm  are  considered,  and  their  rela- 
tive efficiency  (in  terms  uT  number  of  iterations  for  convergence)  is 
evaluated.  The  variations  being  considered  are  as  follows: 

(i)  SGRA-CR,  sequential  gradient-restoration  algorithm,  complete  restoration, 

(ii)  SGRA-IR,  sequential  gradient-restoration  algorithm,  incomplete  restoration, 

(iii)  CGRA-NR,  combined  gradient-restoration  algorithm,  no  restoration, 

(iv)  CGRA-AR,  combined  gradient-restoration  algorithm,  alternate  restoration. 

Evaluation  of  these  algorithms  is  accomplished  through  six  numerical 
examples.  The  results  indicate  that  (a)  the  inclusion  of  a restoration 
phase  is  necessary  for  rapid  convergence  und  (b)  the  algorithms  with  alter- 
nate restoration  are  the  most  efficient  among  those  considered  here. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  gradient 
algorithm,  restoration  algorithm,  gradient-restoration  algorithm. 
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4.  MIELE,  A.,  Gradient  Methods  in  Optimal  Control  Theory,  Rice  University, 
Aero-Astronautics  Report  No. 98,  1971. 

Abstract.  In  this  paper,  recent  work  performed  at  Rice  University  on 
gradient  methods  in  optimal  control  theory  is  presented  from  a unified 
point  of  view.  The  problem  considered  is  that  of  minimizing  a functional 
I with  respect  to  the  state  x(6)  and  the  control  u ( 6 ) which  satisfy  a 
vector  differential  constraint,  a vector  initial  condition,  and  a vector 
final  condition.  The  algorithms  presented  are  two:  (i)  the  sequential 
gradient-restoration  algorithm  and  (ii)  the  combined  gradient-restoration 
algorithm. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  gradient 
algorithm,  restoration  algorithm,  sequential  gradient-restoration  algorithm, 
combined  gradient-restoration  algorithm. 
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5.  HENNIG,  G.  R.,  and  MIELE,  A.,  Sequential  Gradient-Restoration  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part  1,  Theory , 
Rice  University,  Aero-Astronautics  Report  No. 101,  1972. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a 
state  variable  inequality  constraint,  and  terminal  constraints.  The  prob- 
lem is  to  find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so 
that  the  functional  is  minimized,  while  the  constraints  are  satisfied  to  a 
predetermined  accuracy. 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles,  each 
composed  of  a gradient  phase  and  a restoration  phase.  The  gradient  phase 
involves  a single  iteration  and  is  designed  to  decrease  the  functional, 
while  the  constraints  are  satisfied  to  first  order.  The  restoration  phase 
involves  one  or  several  iterations  and  is  designed  to  restore  the  con- 
straints to  a predetermined  accuracy,  while  the  norm  of  the  variations  of 
the  control  and  the  parameter  is  minimized.  The  principal  property  of  the 
algorithm  is  that  it  produces  a sequence  of  feasible  suboptimal  solutions: 
the  functions  x(t),  u(t),  u obtained  at  the  end  of  each  cycle  satisfy  the 
constraints  to  a predetermined  accuracy.  Therefore,  the  functionals  of  any 
two  elements  of  the  sequence  are  comparable. 

Here,  the  state  variable  inequality  constraint  is  handled  in  a 
direct  manner.  A predetermined  number  and  sequence  of  subarcs  is  assumed 
and,  for  the  time  interval  for  which  the  trajectory  of  the  system  lies  on 
the  state  boundary,  the  control  is  determined  so  that  the  state  boundary 
is  satisfied.  The  state  boundary  and  the  entrance  conditions  are  assumed 
to  be  linear  in  x and  tj  , and  the  sequential  gradient-restoration  algorithm 
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is  constructed  in  such  a way  that  the  state  variable  inequality  constraint 
is  satisfied  at  each  iteration  of  the  gradient  phase  and  the  restoration  phase 
along  all  of  the  subarcs  composing  the  trajectory. 

At  first  glance,  the  assumed  linearity  of  the  state  boundary  and  the 
entrance  conditions  appears  to  be  a limitation  to  the  theory.  Actually, 
this  is  not  the  case.  The  reason  is  that  every  constrained  minimization 
problem  can  be  brought  to  the  present  form  through  the  introduction  of 
additional  state  variables. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  9 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that 
each  of  the  subarcs  composing  the  extremal  arc  has  a normalized  time  length 
At  = 1.  In  this  way,  variable-time  corner  conditions  and  variable-time 
terminal  conditions  are  transformed  into  fixed-time  corner  conditions  and 
fixed-time  terminal  conditions.  The  actual  times  6i,  02,  t at  which  (i)  the 
state  boundary  is  entered,  (ii)  the  state  boundary  is  exited,  and  (iii)  the 
terminal  boundary  is  reached  are  regarded  to  be  components  of  the  para- 
meter it  being  optimized. 

Several  numerical  examples  illustrating  the  theory  of  this  paper  are 
given  in  Part  2 (see  Ref. 6).  These  examples  demonstrate  the  feasibility 
as  well  as  the  rapidity  of  convergence  of  the  technique  developed  in  this 
paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  sequential  gradient-restoration  algorithm, 
anchoring  conditions. 
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6.  HENNIG,  G.  R.,  and  MIELE,  A.,  Sequential  Gradient-Restoration  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part  2,  Ex- 
amples , Rice  University,  Aero-Astronautics  Report  No. 102,  1972. 

Abstract.  In  Ref. 5,  Hennig  and  Miele  developed  the  sequential  gradient- 
restoration  algorithm  for  minimizing  a functional  subject  to  differential 
constraints,  a state  variable  inequality  constraint,  and  terminal  con- 
straints. In  this  report,  six  numerical  examples  are  presented,  four  per- 
taining to  the  fixed-final-time  case  and  two  pertaining  to  the  free-final- 
time case.  The  numerical  results  show  the  rapid  convergence  characteristics 
of  the  sequential  gradient-restoration  algorithm  of  Ref. 5. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  sequential  gradient-restoration  algorithm, 
anchoring  conditions. 
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7.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.,  Modified  Quasilinearization 

Algorithm  for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part  1 , 
Theory,  Rice  University,  Aero-Astronautics  Report  No. 103,  1972. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a 
state  variable  inequality  constraint,  and  terminal  constraints.  The  prob- 
lem is  to  find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so 
the  the  functional  is  minimized,  while  the  constraints  are  satisfied  to  a 
predetermined  accuracy. 

A modified  quasi  1 inearization  algorithm  is  developed.  Its  main  prop- 
erty is  the  descent  property  in  the  performance  index  R,  the  cumulative 
error  in  the  constraints  and  the  optimum  conditions.  Modified  quasilineari- 
zation differs  from  ordinary  quasi  linearization  because  of  the  inclusion  of 
the  scaling  factor  (or  stepsize)  a in  the  system  of  variations.  The  step- 
size  is  determined  by  a one-dimensional  search  on  the  performance  index  R. 
Since  the  first  variation  SR  is  negative,  the  decrease  in  R is  guaranteed 
if  a is  sufficiently  small.  Convergence  to  the  solution  is  achieved  when 
R becomes  smaller  than  some  preselected  value. 

Here,  the  state  variable  inequality  constraint  is  handled  in  a direct 
manner.  A predetermined  number  and  sequence  of  subarcs  is  assumed  and, 
for  the  time  interval  for  which  the  trajectory  of  the  system  lies  on  the 
state  boundary,  the  control  is  determined  so  that  the  state  boundary  is 
satisfied.  The  state  boundary  and  the  entrance  conditions  are  assumed  to 
be  linear  in  x and  tt  , and  the  modified  quasilinearization  algorithm  is 
constructed  In  such  a way  that  the  slate  variable  inequality  constraint 
is  satisfied  at  each  iteration  and  along  all  of  the  subarcs  composing 
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the  trajectory. 

At  first  glance,  the  assumed  linearity  of  the  state  boundary  and  the 
entrance  conditions  appears  to  be  a limitation  to  the  theory.  Actually, 
this  is  not  the  case.  The  reason  is  that  every  constrained  minimization 
problem  can  be  brought  to  the  present  form  through  the  introduction  of  ad- 
ditional state  variables. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  6 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that 
each  of  the  subarcs  composing  the  extremal  arc  has  a normalized  time  length 
At  = 1 . In  this  way,  variable-time  corner  conditions  and  variable-time 
terminal  conditions  are  transformed  into  fixed-time  corner  conditions  and 
fixed-time  terminal  conditions.  The  actual  times  0lf  02,  t at  which 
(i)  the  state  boundary  is  entered,  ( i i ) the  state  boundary  is  exited,  and 
(iii)  the  terminal  boundary  is  reached  are  regarded  to  be  components  of  the 
parameter  tt  being  optimized. 

In  order  to  start  the  algorithm,  some  nominal  functions  x(t),  u(t), 
it  and  nominal  multipliers  A(t),  p(t),  o,  p must  be  chosen.  In  a real 
problem,  the  selection  of  the  nominal  functions  can  be  made  on  the  basis 
of  physical  considerations.  Concerning  the  nominal  multipliers,  no  useful 
guidelines  have  been  available  thus  far.  In  this  paper,  an  auxiliary  mini- 
mization algorithm  for  selecting  the  multipliers  optimally  is  presented: 
the  performance  index  R is  minimized  with  respect  to  A ( t ) , p(t),  a,  p. 

Since  the  functional  R is  quadratical ly  dependent  on  the  multipliers,  the 
resulting  variational  problem  Is  governed  by  optimality  conditions  which 
are  linear  and,  therefore,  can  be  solved  without  difficulty. 


Several  numerical  examples  illustrating  the  theory  of  this  paper 
are  given  in  Part  2 (see  Ref. 9).  These  examples  demonstrate  the  feasi- 
bility as  well  as  the  rapidity  of  convergence  of  the  technique  developed 
in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  modified  quasilinearization  algorithm, 
anchoring  conditions. 
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8.  HUANG,  H.  Y.,  and  NAQVI,  S. , Extremi zation  of  Terminally  Constrained  Con- 
trol Problems,  Rice  University,  Aero-Astronautics  Report  No. 104,  1972. 

Abstract.  In  this  paper,  the  problem  of  extremizing  a functional  I in- 
volving the  state  x(t),  the  control  u(t),  and  the  parameter  n is  considered. 

The  admissible  state,  control,  and  parameter  are  required  to  sat'sfy  a 
vector  differential  constraint,  a vector  initial  constraint,  and  a vector 
terminal  constraint. 

This  problem  is  transformed  into  a mathematically  simpler,  uncon- 
strained problem  of  minimizing  a new  functional , the  performance  index  R.  In 
turn,  R involves  the  state,  the  control,  the  parameter,  the  Lagrange  multiplier 
A ( t ) associated  with  the  vector  differential  constraint,  and  the  Lagrange 
multiplier  p associated  with  the  vector  terminal  constraint.  To  obtain  the 
minimum  R * 0 of  the  performance  index,  a gradient  algorithm  is  first  de- 
veloped. In  order  to  achieve  simplicity  in  prograrrming  and  to  bypass  the 
explicit  use  of  second-order  derivatives,  the  gradient  algorithm  fs 
modified  so  that  it  becomes  a pure,  first-order  method.  For  better  con- 
vergence property,  a conjugate-gradient  algorithm  is  also  developed. 

Concerning  the  determination  of  the  stepsize  in  these  algorithms,  a 
one-cycle  cubic  interpolation  scheme  is  presented.  Again,  the  explicit 
use  of  second-order  derivatives  is  avoided  here. 

Both  the  gradient  algorithm  and  the  conjugate-gradient  algorithm  are 
tested  through  several  numerical  examples.  The  results  show  that,  while 
the  gradient  algorithm  is  relatively  slow  in  convergence,  the  conjugate-gradient 
algorithm  displays  better  convergence  characteristics. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  terminal 
constraints,  performance  index,  gradient  algorithm,  conjugate-gradient 
algorithm. 
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9.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.,  Modified  Quasilinearization 


Algorithm  for  Optimal  Control  Problems  with  Bounded  State  Variables,  Part 


2,  Examples,  Rice  University,  Aero-Astronautics  Report  No. 105,  1972. 

Abstract.  In  Ref. 7,  Miele,  Well,  and  Tietze  developed  the  modified  quasi- 
linearization algorithm  for  minimizing  a functional  subject  to  differential 
constraints,  a state  variable  inequality  constraint,  and  terminal  constraints. 
In  this  report,  six  numerical  examples  are  presented,  four  pertaining  to  the 


fixed-final-time  case  and  two  pertaining  to  the  free-final -time  case.  The 
numerical  results  show  the  rapid  convergence  characteristics  of  the  modified 
quasilinearization  algorithm  of  Ref. 7. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  modified  quasilinearization  algorithm, 
anchoring  conditions. 
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10.  HUANG,  H.  Y.,  and  ESTERLE,  A.,  Some  Properties  of  the  Sequential  Gradient- 
Restoration  Algorithm  and  the  Modified  Quasi  1 inearization  Algorithm  for 
Optimal  Control  Problems  with  Bounded  State,  Rice  University,  Aero-Astro- 
nautics  Report  No. 106,  1972. 

Abstract.  In  Refs. 5-7  and  9,  the  sequential  gradient-restoration  algorithm 
and  the  modified  quasilinearization  algorithm  were  developed  for  optimal 
control  problems  with  bounded  state.  These  algorithms  have  a basic  property: 
for  a subarc  lying  on  the  state  boundary,  the  state  boundary  equations  are 
satisfied  at  every  iteration,  if  they  are  satisfied  at  the  beginning  of 
the  computational  process.  Thus,  the  subarc  remains  anchored  on  the  state 
boundary.  In  this  paper,  the  anchoring  conditions  employed  in  Refs. 5-7  and 
9 are  derived. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  sequential  gradient-restoration  algorithm, 
modified  quasi  1 inearization  algorithm,  anchoring  conditions. 
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11.  MIELE,  A.,  AGGARWAL,  A.  K. , and  TIETZE,  J.  L.,  Solution  of  a Two-Point 
Boundary-Value  Problem  with  ^cobian  Matrix  Characterized  by  Extremely 
Large  Eigenvalues,  Rice  University,  Aero-Astronautics  Report  No. 107,  1972. 

Abstract.  This  paper  treats  the  nonlinear,  two-point  boundary-value  problem 
x - k sinh  (kx)  = 0,  x(0)  = 0,  x ( 1 ) = 1, 
for  relatively  large  values  of  k,  namely,  k = 5,  k = 6,  and  k = 10.  Com- 
putationally speaking,  this  is  an  extremely  difficult  problem,  owing  to 
the  fact  that  the  Jacobian  matrix  is  characterized  by  an  extremely  large 
positive  eigenvalue:  for  k = 10,  the  order  of  magnitude  of  this  positive 
eigenvalue  near  the  final  point  is  10^. 

The  resulting  numerical  difficulties  are  reduced  by  treating  the  two- 
point  boundary-value  problem  as  a multipoint  boundary- value  problem.  The 
modified  quasi  1 inearization  algorithm  of  Ref. 12  is  employed.  This 
is  a totally  finite-  difference  approach,  which  bypasses  the  integration 
of  the  nonlinear  equations,  which  characterizes  shooting  methods.  Solutions 
for  x(t)  precise  to  six  significant  figures  are  obtained. 

Key  Words.  Differential  equations,  stiff  differential  equations,  numerical 
methods,  computing  methods,  eigenvalues,  two-point  boundary-value  problem, 
multipoint  boundary- value  problem,  modified  quasilinearization  algorithm. 
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12.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.,  Multipoint  Approach  to  the  Two- 
Point  Boundary-Value  Problem,  Rice  University,  Aero-Astronautics  Report 
No. 108,  1972. 

Abstract.  This  paper  treats  nonlinear,  two-point  boundary-value  problems 
of  the  form  x -4>(x,t)  = 0,  in  which  the  Jacobian  matrix  *x(x,t)  is  charac- 
terized by  large  positive  eigenvalues.  The  resulting  numerical  difficul- 
ties are  reduced  by  treating  the  two-point  boundary-value  problem  as  a 
multipoint  boundary-value  problem.  A totally  finite-difference  approach 
is  employed,  thus  bypassing  the  often  troublesome  integration  of  the  non- 
linear equations,  which  characterizes  shooting  methods. 

The  approach  employed  consists  of  extending  to  multipoint  boundary- 
value  problems  the  modified  quasi  1 inearization  method  developed  by  Miele 
and  Iyer  for  two-point  boundary- value  problems.  Basic  to  the  method  is 
the  consideration  of  the  performance  index  P,  the  cumulative  error  in  the 
differential  equations,  the  boundary  conditions,  and  the  interface  conditions. 

A modified  quasilinearizatior  algorithm  is  generated  by  requiring 
the  first  variation  of  the  performance  index  6P  to  be  negative.  This  algo- 
rithm differs  from  the  ordinary  quasilinearization  algorithm  because  of  the 
inclusion  of  the  scaling  factor  or  stepsize  a in  the  system  of  variations. 

The  main  property  of  the  modified  quasi  1 inearization  algorithm  is  the  de- 
scent property:  if  the  stepsize  a is  sufficiently  small,  the  reduction  in 

P is  guaranteed.  Convergence  to  the  desired  solution  is  achieved  when  the 
inequality  P < c is  met,  where  e is  a small,  preselected  number. 

The  variations  per  unit  stepsize  Ax(t)/a  = A(t)  are  governed  by  a 
system  of  mn  nonhomogeneous , linear  differential  equations  subjected  to  p 
initial  conditions,  q final  conditions,  and  (m-l)n  interface  conditions. 
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with  p + q = n,  where  n is  the  dimension  of  the  vector  x and  m is  the 
number  of  subintervals.  Therefore,  the  total  number  of  boundary  conditions 
and  interface  conditions  is  mn.  The  above  system  is  solved  employing  the 
method  of  particular  solutions:  m(n+l)  particular  solutions  are  combined 
linearly,  and  the  coefficients  of  the  combination  are  determined  so  that 
the  linear  system  is  satisfied. 

Four  numerical  examples  are  presented,  two  dealing  with  linear  systems 
and  two  dealing  with  nonlinear  systems.  The  examples  illustrate  the  effec- 
tiveness as  well  as  the  rapidity  of  convergence  of  the  present  method. 

Key  Words.  Differential  equations,  stiff  differential  equations,  numerical 
methods,  computing  methods,  eigenvalues,  two-point  boundary-value  problem, 
multipoint  boundary-value  problem,  modified  quasilinearization  algorithm. 
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13.  MIELE,  A.,  DAMOULAKIS,  J.  N.,  and  CLOUTIER,  J.  R. , Sequential  Gradient- 
Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  1,  Theory,  Rice  University,  Aero-Astronautics  Report 
No. 109,  1973. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  non- 
differential constraints,  and  terminal  constraints.  The  problem  is  to  find 
the  state  x(t),  the  control  u(t),and  the  parameter  tt  so  that  the  functional 
is  minimized,  while  the  constraints  are  satisfied  to  a predetermined 
accuracy. 

I 

•i 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles,  each 
composed  of  a gradient  phase  and  a restoration  phase.  The  gradient  phase 
involves  a single  iteration  and  is  designed  to  decrease  the  functional, 
while  the  constraints  are  satisfied  to  first  order.  The  restoration  phase 
involves  one  or  several  iterations  and  is  designed  to  restore  the  con- 
straints to  a predetermined  accuracy,  while  the  norm  of  the  variations  of 
the  control  and  the  parameter  is  minimized. 

The  principal  property  of  the  algorithm  is  that  it  produces  a sequence 
of  feasible  suboptimal  solutions:  the  functions  x(t),  u(t),  u obtained  at 
the  end  of  each  cycle  satisfy  the  constraints  to  a predetermined  accuracy. 
Therefore,  the  functionals  of  any  two  elements  of  the  sequence  are  comparable. 

The  stepsize  of  the  gradient  phase  is  determined  by  a one-dimensional 
search  on  the  augmented  functional  J,  and  the  stepsize  of  the  restoration 
phase  by  a one-dimensional  search  on  the  constraint  error  P.  If  is  the 
gradient  stepsize  and  ur  is  the  restoration  stepsize,  the  gradient  correc- 
tions are  of  0(ag)  and  the  restoration  corrections  are  of  0(arrigj.  There- 
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fore,  for  ag  sufficiently  small,  the  restoration  phase  preserves  the  de- 

A 

scent  property  of  the  gradient  phase:  the  functional  I at  the  end  of  any 
cycle  is  smaller  than  the  functional  I at  the  beginning  of  the  cycle. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  9 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that  the 
extremal  arc  has  a normalized  time  length  At  = 1.  In  this  way,  variable- 
time terminal  conditions  are  transformed  into  fixed-time  terminal  conditions. 
The  actual  time  x at  which  the  terminal  boundary  is  reached  is  regarded  to 
be  a component  of  the  parameter  it  being  optimized. 

The  present  general  formulation  differs  from  that  contained  in  previous 
work  by  Miele,  Pritchard,  and  Damoulakis  because  of  the  inclusion  of  the 
nondifferential  constraints  to  be  satisfied  everywhere  over  the  interval 
0 < t < 1.  Its  importance  lies  in  that  (i)  many  optimization  problems  arise 
directly  in  the  form  considered  here,  (ii)  problems  involving  state  equality 
constraints  can  be  reduced  to  the  present  scheme  through  suitable  transfor- 
mations, and  (iii)  problems  involving  inequality  constraint  can  be  reduced 
to  the  present  scheme  through  suitable  transformations.  The  latter  state- 
ment applies,  for  instance,  to  the  following  situations:  (a)  problems  with 
bounded  control,  (b)  problems  with  bounded  state,  (c)  problems  with  bounded 
time  rate  of  change  of  the  state,  and  (d)  problems  where  some  bound  is  im- 
posed on  an  arbitrarily  prescribed  function  of  the  parameter,  the  control, 
the  state,  and  the  time  rate  of  change  of  the  state. 

Numerical  examples  are  presented  in  Parts  2 and  3 for  both  the  fixed- 
final-time  case  and  the  free-final -time  case  (see  Refs. 14  and  15).  These 
examples  demonstrate  the  feasibility  as  well  as  the  rapidity  of  convergence 
of  the  technique  developed  in  this  paper. 


34 


AAR- 132 


i 


Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  non- 
differential constraints,  transformation  techniques,  sequential  gradient- 
restoration  algorithm. 
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14.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.  R.,  Sequential  Gradient- 

Restoration  Algorithm  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  2,  Examples,  Rice  University,  Aero-Astronautics  Report 
No.110,  1973. 

Abstract.  In  Ref. 13,  Miele,  Damoulakis,  and  Cloutier  developed  the  se- 
quential gradient-restoration  algorithm  for  minimizing  a functional  sub- 
ject to  differential  constraints,  nondifferential  constraints,  and  terminal 
constraints.  In  this  report,  several  numerical  examples  are  presented, 
some  pertaining  to  the  fixed-final -time  case  and  some  pertaining  to  the 
free-final-time  case.  Both  equality  constrained  optimization  problems  and 
problems  with  bounded  control  are  investigated.  The  numerical  results 
show  the  rapid  convergence  characteristics  of  the  sequential  gradient-resto- 
ration algorithm  of  Ref. 13. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods , non- 
differential constraints,  transformation  techniques,  sequential  gradient- 
restoration  algorithm. 
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15.  MIELE,  A.,  DAMOULAKIS,  J.  N.  and  TIETZE,  J.  L.,  Sequential  Gradient- 
Restoration  Algorithn,  for  Optimal  Control  Problems  with  Nondifferential 
Constraints,  Part  3,  Examples,  Rice  University,  Aero-Astronautics  Report 
No. Ill,  1973. 

Abstract.  In  Ref. 13,  Miele,  Damoulakis,  and  Cloutier  developed  the  se- 
quential gradient-restoration  algorithm  for  minimizing  a functional  sub- 
ject to  differential  constraints,  nondifferential  constraints,  and  terminal 
constraints.  In  this  report,  several  numerical  examples  are  presented, 
some  pertaining  to  the  fixed-final-time  case  and  some  pertaining  to  the 
free-final-time  case.  Both  problems  with  bounded  state  and  problems  with 
bounded  time  rate  of  change  of  the  state  are  investigated.  The  numerical 
results  show  the  rapid  convergence  characteristics  of  the  sequential 
gradient-restoration  algorithm  of  Ref. 13. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  nondif- 
ferential constraints,  transformation  techniques,  sequential  gradient-res- 
toration algorithm. 
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16.  MIELE,  A.,  MANGIAVACCHI , A.,  and  AGGARWAL,  A.K.,  Modified  Quasilineariza- 
tion  Algorithm  for  Optimal  Control  Problems  with  Nondifferential  Con- 
straints, Part  1,  Theory,  Rice  University,  Aero-Astronautics  Report  No. 

112,  1973. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  non- 
differential constraints,  and  terminal  constraints.  The  problem  is  to  find 
the  state  x(t),  the  control  u(t),  and  the  parameter  n so  that  the  functional 
is  minimized,  while  the  constraints  are  satisfied  to  a predetermined  accuracy. 

A modified  quasi  1 inearization  algorithm  is  developed.  Its  main 
property  is  the  descent  property  in  tie  performance  index  R,  the  cumulative 
error  in  the  constraints  and  the  optimality  conditions.  Modified  quasi- 
linearization differs  from  ordinary  quasilinearization  because  of  the  in- 
clusion of  the  scaling  factor  or  stepsize  a in  the  system  of  variations. 

The  stepsize  is  determined  by  a one-dimensional  search  on  the  performance 
index  R.  Since  the  first  variation  6R  is  negative,  the  decrease  in  R is 
guaranteed  if  a is  sufficiently  small.  Convergence  to  the  solution  is 
achieved  when  R becomes  smaller  than  some  preselected  value. 

In  order  to  start  the  algorithm,  some  nominal  functions  x(t),  u(t), 
it  and  nominal  multipliers  X ( t ) , p(t),  p must  be  chosen.  In  a real  problem, 
the  selection  of  the  nominal  functions  can  be  made  on  the  basis  of  physical 
considerations.  Concerning  the  nominal  multipliers,  no  useful  guidelines 
have  been  available  thus  far.  In  this  paper,  an  auxiliary  minimization 
algorithm  for  selecting  the  multipliers  optimally  is  presented:  the  perfor- 
mance index  R Is  minimized  with  respect  to  X ( t ) , p(t),  p . Since  the 
functional  R Is  quadratically  dependent  on  the  multipliers,  the  resulting 
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variational  problem  is  governed  by  optimality  conditions  which  are  linear 
and,  therefore,  can  be  solved  without  difficulty. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
t;me  0 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that  the 
extrenal  arc  has  a normalized  time  length  At  = 1 . In  this  way,  variable- 
time terminal  conditions  are  transformed  into  fixed-time  terminal  conditions. 
The  actual  time  r at  which  the  terminal  boundary  is  reached  is  regarded  to 
be  a component  of  the  parameter  it  being  optimized. 

The  present  general  formulation  differs  from  that  contained  in  previous 
work  by  Miele,  Iyer-,  and  Well  because  of  the  inclusion  of  the  nondifferential 
constraints  to  be  satisfied  everywhere  over  the  interval  0 <_  t < 1 . Its 
importance  lies  in  that  (i)  many  optimization  problems  arise  directly  in 
the  form  considered  here,  (ii)  there  are  problems  involving  state  equality 
constraints  which  can  be  reduced  to  the  present  scheme  through  suitable 
transformations,  and  (iii)  there  are  problems  involving  inequality  con- 
straints which  can  be  reduced  to  the  present  scheme  through  the  introduc- 
tion of  auxiliary  variables. 

Numerical  examples  are  presented  in  Part  2 for  both  the  fixed-final - 
time  case  and  the  free-final-time  case  (see  Ref. 17).  These  examples  demon- 
strate the  feasibility  as  well  as  the  rapidity  of  convergence  of  the  tech- 
nique developed  in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  nondif- 
ferential constraints,  transformation  techniques,  modified  quasilineariza- 
tion algorithm. 
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17.  MIELE.  A.,  MANGIAVACCHI , A.,  and  AGGARWAL,  A.  K. , Modified  Quasi  1 ineariza- 
tion  Algorithm  for  Optimal  Control  Problems  with  Nondifferential  Constraints, 
Part  2,  Examples,  Rice  University,  Aero-Astronautics  Report  No. 113,  1973. 

Abstract.  In  Ref. 16,  Miele,  Mangiavacchi , and  Aggarwal  developed  the  modi- 
fied quasi  1 inearization  algorithm  for  minimizing  a functional  subject  to 
differential  constraints,  nondifferential  constraints,  and  terminal  con- 
straints. In  this  report,  several  numerical  examples  are  presented,  some 
pertaining  to  the  fixed-final-time  case  and  some  pertaining  to  the  free- 
final-time  case.  Both  equality  constrained  optimization  problems  and  in- 
equality constrained  optimization  problems  are  investigated.  The  numerical 
results  show  the  rapid  convergence  characteristics  of  the  modified  quasi- 
linearization  algorithm  of  Ref. 16. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  nondif- 
ferential constraints,  transformation  techniques,  modified  quasi  1 ineariza- 
tion algorithm. 
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18.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.  R. , A Hybrid  Approach  to 
Optimal  Control  Problems  with  Bounded  State,  Part  1,  Theory,  Rice 
University,  Aero-Astronautics  Report  No. 114,  1974. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a 
state  inequality  constraint,  and  terminal  constraints.  The  problem  is  to 
find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so  that  the 
functional  is  minimized,  while  the  constraints  are  satisfied  to  a prede- 
termined accuracy. 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles, 
each  composed  of  a gradient  phase  and  a restoration  phase.  The  gradient 
phase  involves  a single  iteration  and  is  designed  to  decrease  the  functional, 
while  the  constraints  are  satisfied  to  first  order.  The  restoration  phase 
involves  one  or  several  iterations  and  is  designed  to  restore  the  con- 
straints to  a predetermined  accuracy,  while  the  norm  of  the  variations  of 
the  control  and  the  parameter  is  minimized.  The  principal  property  of  the 
algorithm  is  that  it  produces  a sequence  of  feasible  suboptimal  solutions: 
the  functions  x(t),  u(t),  ti  obtained  at  the  end  of  each  cycle  satisfy  the 
constraints  to  a predetermined  accuracy.  Therefore,  the  functionals  of 
any  two  elements  of  the  sequence  are  comparable. 

The  technique  employed  is  of  the  hybrid  type,  in  an  attempt  to  com- 
bine some  of  the  best  features  of  the  direct  approach  and  the  indirect 
approach.  While  a predetermined  number  and  sequence  of  subarcs  are  assumed 
(a  feature  of  direct  methods),  enforcement  of  the  state  inequality  con- 
straint is  obtained  through  a Valentine-type  representation  (a  feature  of 
Indirect  methods). 
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By  properly  choosing  the  analytical  form  of  certain  nondifferential 
constraints  to  be  satisfied  by  the  augmented  control  along  each  subarc 
composing  the  extremal  arc  (these  nondifferential  constraints  are  arrived 
at  through  the  Valentine-type  transformation),  one  ensures  satisfaction  of 
the  state  inequality  constraint  everywhere.  Specifically,  strict  inequality 
is  enforced  for  the  subarcs  internal  to  the  state  boundary  and  strict 
equality  is  enforced  for  the  subarcs  lying  on  the  state  boundary. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  0 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that 
each  subarc  composing  the  extremal  arc  has  a normalized  time  length  At  = 1 . 
In  this  way,  variable-time  corner  conditions  and  variable-time  terminal  con- 
ditions are  transformed  into  fixed-time  corner  conditions  and  fixed-time 
terminal  conditions.  The  actual  times  6,,  02,  t at  which  (i)  the  state 
boundary  is  entered,  (ii)  the  state  boundary  is  exited,  and  (iii)  the 
terminal  manifold  is  reached  are  regarded  to  be  components  of  the  para- 
meter ir  being  optimized. 

Five  numerical  examples  illustrating  the  theory  are  given  in  Part  2 
(see  Ref. 19)  and  demonstrate  the  feasibility  as  well  as  the  rapidity  of 
convergence  of  the  technique  developed  in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  nondifferential  constraints,  hybrid  approach,  sequential  gradient- 
restoration  algorithm. 
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19.  MIELE,  A.,  TIETZE,  J.  1.,  and  CLOUTIER,  J.R.,  A Hybrid  Approach  to  Op- 
timal Control  Problems  with  Bounded  State,  Part  2,  Examples,  Rice  Uni- 
versity, Aero-Astronautics  Report  No. 115,  1974. 

Abstract.  In  Ref. 18,  Miele,  Tietze,  and  Cloutier  developed  a modification 
of  the  sequential  gradient-restoration  algorithm  for  minimizing  a functional 
subject  to  differential  constraints,  a state  inequality  constraint,  and 
terminal  constraints.  In  this  report,  five  numerical  examples  are  pre- 
sented, some  pertaining  to  the  fixed-final -time  case  and  some  pertaining  to 
the  free-final-time  case.  he  numerical  results  show  the  rapid  convergence 
characteristics  of  the  modification  of  the  sequential  gradient-restoration 
algorithm  discussed  in  Ref. 18. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  nondifferential  constraints,  hybrid  approach,  sequential  gradient- 
restoration  algorithm. 
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20.  HEIDEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Res- 
toration Algorithm  for  Optimal  Control  Problems,  Part  1,  Theory , Rice 
University,  Aero-Astronautics  Report  No. 116,  1974. 

Abstract.  This  paper  considers  the  problem  of  minimizing  a functional  I 
which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  n . 

Here,  I is  a scalar,  x an  n-vector,  u an  m-vector,  and  tt  a p-vector.  At 
the  initial  point,  the  state  is  prescribed.  At  the  final  point,  the  state 
and  the  parameter  are  required  to  satisfy  q scalar  relations.  Along  the 
interval  of  integration,  the  state,  the  control,  and  the  parameter  are 
required  to  satisfy  n scalar  differential  equations. 

First,  the  case  of  a quadratic  functional  subject  to  linear  constraints 
is  considered,  and  a conjugate  gradient  algorithm  is  derived.  Nominal  func- 
tions x(t),  u(t),  it  satisfying  all  the  differential  equations  and  boundary 
conditions  are  assumed.  Variations  Ax(t),  Au(t),  Att  are  determined  so  that 
the  value  of  the  functional  is  decreased.  These  variations  are  obtained  by 
minimizing  the  first-order  change  of  the  functional  subject  to  the  linearized 
differential  equations,  the  linearized  boundary  conditions,  and  a quadratic 
constraint  on  the  variations  of  the  control  and  the  parameter. 

Next,  the  more  general  case  of  a nonquadratic  functional  subject  to 
nonlinear  constraints  is  considered.  The  algorithm  derived  for  the  linear- 
quadratic  case  is  employed  with  one  modification:  a restoration  phase  is 
inserted  between  any  two  successive  conjugate  gradient  phases. 

In  the  restoration  phase,  variations  Ax(t),  Au(t),  Air  are  determined 
by  requiring  the  least-square  change  of  the  control  and  the  parameter  subject 
to  the  linearized  differential  equations  and  the  linearized  boundary  con- 
ditions. Thus,  a sequential  conjugate  gradient-restoration  algorithm  is 
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constructed  in  such  a way  that  the  differential  equations  and  the 
boundary  conditions  are  satisfied  at  the  end  of  each  complete  conjugate 
gradient-restoration  cycle. 

Several  numerical  examples  illustrating  the  theory  of  this  paper  are 
given  in  Part  2 (see  Ref. 21).  These  examples  demonstrate  the  feasibility 
as  well  as  the  rapidity  of  convergence  of  the  technique  developed  in  this 
paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  se- 
quential conjugate  gradient-restoration  algorithm. 
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21.  HEIDEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Restora- 
tion Algorithm  for  Optimal  Control  Problems,  Part  2,  Examples,  Rice  Uni- 
versity, Aero-Astronautics  Report  No. 117,  1974. 

Abstract.  In  Ref. 20,  Heideman  and  Levy  developed  the  sequential  conjugate 
gradient-restoration  algorithm  for  minimizing  a functional  subject  to  dif- 
ferential constraints  and  terminal  constraints.  In  this  report,  several 
numerical  examples  are  presented,  some  pertaining  to  a quadratic  functional 
subject  to  linear  constraints  and  some  pertaining  to  a nonquadratic  func- 
tional subject  to  nonlinear  constraints.  These  examples  demonstrate  the 
feasibility  as  well  as  the  rapid  convergence  characteristics  of  the  sequen- 
tial conjugate  gradient-restoration  algorithm  of  Ref. 20. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  sequential 
conjugate  gradient-restoration  algorithm. 
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22.  AGGARWAL,  A.  K.,  Some  Numerical  Results  on  Holt's  Two-Point  Boundary- 
Value  Problem,  Rice  University,  Aero-Astronautics  Report  No. 118,  1973. 

Abstract.  This  paper  treats  the  nonlinear,  two-point  boundary-value 
problem  formulated  by  Holt  for  relatively  large  values  of  the  final  time  x , 
namely,  t = 11.3,  x = 13.3,  and  x = 20.0.  Computationally  speaking,  this 
is  a difficult  problem,  owing  to  the  fact  that  the  Jacobean  matrix  is 
characterized  by  relatively  large  positive  eigenvalues. 

The  resulting  numerical  difficulties  are  reduced  by  treating  the 
two-point  boundary-value  problem  as  a multipoint  boundary-value  problem. 

The  modified  quasilinearization  algorithm  of  Ref. 12  is  employed. 

This  approach  bypasses  the  integration  of  the  nonlinear  equations,  which 
characterizes  shooting  methods. 

Key  Words.  Holt's  problem,  differential  equations,  stiff  differential 
equations,  numerical  methods,  computing  methods,  eigenvalues,  two-point 
boundary- value  problem,  multipoint  boundary-value  problem,  modified 
quasilinearization  algorithm. 
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23.  MIELE,  A.,  and  CLOUTIER,  J.  R. , New  Transformation  Technique  for  Optimal 
Control  Problems  with  Bounded  State,  Part  1,  Theory,  Rice  University, 
Aero-Astronautics  Report  No. 122,  1974. 

Abstract.  In  this  paper,  the  numerical  solution  of  optimal  control  problems 
involving  a state  inequality  constraint  of  the  foim  L(x,o)  >_  0 is  considered. 
The  approach  employed  is  of  the  hybrid  type,  in  an  attempt  to  combine  some 
of  the  best  features  of  the  indirect  approach  and  the  direct  approach. 

While  a predetermined  number  and  sequence  of  subarcs  are  assumed  (a  feature 
of  direct  methods),  enforcement  of  the  state  inequality  constraint  is  ob- 
tained through  a Valentine-type  representation  (a  feature  of  indirect 
methods) . 

A new  transformation  technique  is  developed  by  applying  the  Valentine- 
type  representation  to  the  kth  derivative  of  the  function  L(x,0),  assumed 
to  have  a constant  sign  along  each  of  the  subarcs  composing  the  extremal 
arc.  By  properly  choosing  the  analytical  form  of  certain  nondifferential 
constraints  to  be  satisfied  by  the  augmented  control  along  each  subarc  com- 
posing the  extremal  arc  (these  nondifferential  constraints  are  arrived  at 
through  the  Valentine-type  transformation),  one  ensures  satisfaction  of  the 
state  inequality  constraint  everywhere.  Specifically,  strict  inequality  is 
enforced  for  the  subarcs  internal  to  the  state  boundary  and  strict  equality 
is  enforced  for  the  subarcs  lying  on  the  state  boundary. 

Since  the  Valentine-type  representation  is  applied  to  the  kth  derivative 
of  the  function  L(x,6),  rather  than  to  the  function  itself,  problems  with 
bounded  state  can  be  treated  without  augmenting  the  dimension  of  the  state 
vector.  This  concept  is  important  computationally,  in  that  the  computing 
time  per  iteration  increases  with  the  square  of  the  dimension  of  the  state 


vector. 
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The  algorithm  developed  belongs  to  the  class  of  sequential  gradient- 
restoration  algorithms.  The  approach  taken  is  a sequence  of  two-phase  pro- 
cesses or  cycles,  each  composed  of  a gradient  phase  and  a restoration  phase. 
The  gradient  phase  involves  a single  iteration  and  is  designed  to  decrease 
the  functional,  while  the  constraints  are  satisfied  to  first  order.  The 
restoration  phase  involves  one  or  several  iterations  and  is  designed  to 
restore  the  constraints  to  a predetermined  accuracy,  while  the  norm  of  the 
variations  of  the  control  and  the  parameter  is  minimized. 

The  principal  property  of  the  algorithm  is  that  it  produces  a sequence 
of  feasible  suboptimal  solutions:  the  functions  x(t),  u(t),  n obtained  at 
the  end  of  each  cycle  satisfy  the  constraints  to  a predetermined  accuracy. 
Therefore,  the  functionals  of  any  two  elements  of  the  sequence  are  comparable. 

Five  numerical  examples  illustrating  the  theory  are  given  in  Part  2 
(see  Ref. 24).  They  demonstrate  the  feasibility  as  well  as  the  rapidity  of 
convergence  of  the  technique  developed  in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  hybrid  approach,  transformation  techniques,  sequential  gradient- 
restoration  algorithm. 
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24.  MIELE,  A.,  and  CLOUTIER,  J.  R. , New  Transformation  Technique  for  Optimal 
Control  Problems  with  Bounded  State,  Part  2,  Examples,  Rice  University, 
Aero-Astronautics  Report  No. 123,  1974. 

Abstract.  In  Ref. 23,  Miele  and  Cloutier  developed  a new  transformation 
technique  for  optimal  control  problems  with  bounded  state.  This  trans- 
formation technique  was  employed  in  conjunction  with  the  sequential  gradient- 
restoration  algorithm.  In  this  report,  five  numerical  examples  are  pre- 
sented, some  pertaining  to  the  fixed-final -time  case  and  some  pertaining  to 
the  free-final-time  case.  The  numerical  results  show  the  rapid  convergence 
characteristics  of  the  algorithm  discussed  in  Ref. 23. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  hybrid  approach,  transformation  techniques,  sequential  gradient- 
restoration  algorithm. 


50 


AAR-132 


25.  MIELE,  A.,  Recent  Advances  in  Gradient  A1 gorithms  for  Optimal  Control 
Problems,  Rice  University,  Aero-Astronautics  Report  No. 129,  1975. 

Abstract.  This  paper  summarizes  recent  advances  in  the  area  of  gradient 
algorithms  for  optimal  control  problems,  with  particular  emphasis  on  the 
work  performed  by  the  staff  of  the  Aero-Astronautics  Group  of  Rice  Uni- 
versity. 

The  following  basic  problem  is  considered:  minimize  a functional 

I which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  . 
Here,  I is  a scalar,  x an  n-vector,  u an  m-vector,  and  tt  a p-vector.  At 
the  initial  point,  the  state  is  prescribed.  At  the  final  point,  the 
state  x and  the  parameter  tt  are  required  to  satisfy  q scalar  relations. 

Along  the  interval  of  integration,  the  state,  the  control,  and  the  para- 
meter are  required  to  satisfy  n scalar  differential  equations. 

First,  the  sequential  gradient-restoration  algorithm  and  the  com- 
bined gradient-restoration  algorithm  are  presented.  The  descent  properties 
of  these  algorithms  are  studied,  and  schemes  to  determine  the  optimum 
stepsize  are  discussed.  Both  of  the  above  algorithms  require  the  solution 
of  a linear,  two-point  boundary-value  problem  at  each  iteration  Hence, 
a discussion  of  integration  techniques  is  given. 

Next,  a family  of  gradient-restoration  algorithms  is  introduced. 

Not  only  does  this  family  include  the  previous  two  algorithms  as  particular 
cases,  but  it  allows  one  to  generate  several  additional  algorithms,  namely, 
those  with  alternate  restoration  and  optional  restoration. 

Then,  two  modifications  of  the  sequential  gradient-restoration  al- 
gorithm are  presented  in  an  effort  to  accelerate  terminal  convergence. 

In  the  first  modification,  the  quadratic  constraint  imposed  on  the  variations 
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of  the  contro1  is  modified  by  the  inclusion  of  a positive-definite 
weighting  matrix  (the  matrix  of  the  second  derivatives  of  the  Hamiltonian 
with  respect  to  the  control).  The  second  modification  is  a conjugate- 
gradient  extension  of  the  sequential  gradient-restoration  algorithm. 

Next,  the  addition  of  a nondifferential  constraint,  to  be  satisfied 
everywhere  along  the  interval  of  integration,  is  considered.  In  theory, 
this  seems  to  be  only  a minor  modification  of  the  basic  problem.  In 
practice,  the  change  is  considerable  in  that  it  enlarges  dramatically  the 
number  and  variety  of  problems  of  optimal  control  which  can  be  treated  by 
gradient-restoration  algorithms.  Indeed,  by  suitable  transformations,  al- 
most every  known  problem  of  optimal  control  theory  can  be  brought  into 
this  scheme.  This  statement  applies,  for  instance,  to  the  following  situ- 
ations: (i)  problems  with  control  equality  constraints,  (ii)  problems  with 
state  equality  constraints,  (iii)  problems  with  equality  constraints  on 
the  time  rate  of  change  of  the  state,  (iv)  problems  with  control  inequality 
constraints,  (v)  problems  with  state  inequality  constraints,  and  (vi)  prob- 
lems with  inequality  constraints  on  the  time  rate  of  change  of  the  state. 

Finally,  the  simultaneous  presence  of  nondifferential  constraints 
and  multiple  subarcs  is  considered.  The  possibility  that  the  analytical 
form  of  the  functions  under  consideration  might  change  from  one  subarc  to 
another  is  taken  into  account.  The  resulting  formulation  is  particularly 
relevant  to  those  problems  of  optimal  control  involving  bounds  on  the  con- 
trol or  the  state  or  the  time  derivative  of  the  state.  For  these  problems, 
one  might  be  unwilling  to  accept  the  simplistic  view  of  a continuous  ex- 
tremal arc.  Indeed,  one  might  want  to  take  the  more  realistic  view  of  an 
extremal  arc  composed  of  several  subarcs,  some  internal  to  the  boundary 
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being  considered  and  some  lying  on  the  boundary. 

The  paper  ends  with  a section  dealing  with  transformation  techniques. 
This  section  illustrates  several  analytical  devices  by  means  of  which  a 
great  number  of  problems  of  optimal  control  can  be  reduced  to  one  of  the 
formulations  presented  here.  In  particular,  the  following  topics  are 
treated:  (i)  time  normalization,  (ii)  free  initial  state,  ( i 1 i ) bounded 
control,  and  (iv)  bounded  state. 

Key  Words.  Survey  papers,  gradient  methods,  numerical  methods,  computing 
methods,  calculus  of  variations,  optimal  control,  gradient-restoration 
algorithms,  boundary-value  problems,  bounded  control  problems,  bounded 
state  problems,  nondifferential  constraints. 
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26.  MIELE,  A.,  MOHANTY,  B.P.,and  WU,  A.K.,  Conversion  of  Optimal  Control  Problems 
with  Free  Initial  State  into  Optimal  Control  Problems  with  Fixed  Initial 
State,  Rice  University,  Aero-Astronautics  Report  No. 130,  1976. 

Abstract.  This  paper  considers  optimal  control  problems  involving  the 
minimization  of  a functional  subject  to  differential  constraints,  non- 
differential constraints,  initial  conditions,  and  final  conditions.  The 
initial  conditions  can  be  partly  fixed  and  partly  free.  Transformation 
techniques  are  suggested,  by  means  of  which  problems  with  free  initial 
state  are  converted  into  problems  with  fixed  initial  state.  Thereby,  it 
becomes  possible  to  employ,  without  change,  some  of  the  algorithms  al- 
ready developed  for  optimal  control  problems  with  fixed  initial  state 
(for  instance,  the  sequential  gradient-restoration  algorithm). 

The  transformations  introduced  are  two:  (i)  a linear  transformation 
and  (ii)  a nonlinear  transformation.  In  the  linear-quadratic  case,  the 
former  preserves  unchanged  the  basic  structure  of  the  optimization  prob- 
lem, while  this  is  not  the  case  with  the  latter. 

Three  numerical  examples  are  presented,  namely,  one  linear-quadratic 
example  and  two  nonlinear-nonquadratic  examples.  After  transformations 
(i)  and  (ii)  are  introduced,  these  examples  are  solved  by  means  of  the 
sequential  ordinary  gradient-restoration  algorithm  and  the  sequential 
conjugate  gradient-restoration  algorithm. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  trans- 
formation techniques,  sequential  ordinary  gradient-restoration  algorithm, 
sequential  conjugate  gradient-restoration  algorithm,  problems  with  free 
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IX.  Abstracts  of  Papers 

27.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Summary  and  Comparison  of 

Gradient-Restoration  Algorithms  for  Optimal  Control  Problems , Journal  of 
Optimization  Theory  and  Applications,  Vol.10,  No. 6,  1972. 

Abstract.  This  paper  considers  the  problem  of  minimizing  a functional  I 
which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  n . 

Here,  I is  a scalar,  x an  n-vector,  u an  m-vector,  and  n a p-vector.  At 
the  initial  point,  the  state  is  prescribed.  At  the  final  point,  the  state 
and  the  parameter  are  required  to  satisfy  q scalar  relations.  Along  the 
interval  of  integration,  the  state,  the  control,  and  the  parameter  are 
required  to  satisfy  n scalar  differential  equations. 

Four  types  of  gradient-restoration  algorithms  are  considered,  and 
their  relative  efficiency  (in  terms  of  number  of  iterations  for  conver- 
gence) is  evaluated.  The  algorithms  being  considered  are  as  follows: 
sequential  gradient-restoration  algorithm,  complete  restoration  (SGRA-CR), 
sequential  gradient-restoration  algorithm,  incomplete  restoration  (SGRA-IR), 
combined  gradient-restoration  algorithm,  no  restoration  (CGRA-NR),  and 
combined  gradient-restoration  algorithm,  incomplete  restoration  (CGRA-IR). 

Evaluation  of  these  algorithms  is  accomplished  through  six  numerical 
examples.  The  results  indicate  that  (i)  the  inclusion  of  a restoration 
phase  is  necessary  for  rapid  convergence  and  (ii)  while  SGRA-CR  is  the 
most  desirable  algorithm  if  feasibility  of  the  suboptimal  solutions  is 
required,  rapidity  of  convergence  to  the  optimal  solution  can  be  increased 
if  one  employs  algorithms  with  incomplete  restoration,  in  particular, CGRA-IR. 
Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  gradient 
algorithm,  restoration  algorithm,  gradient-restoration  algorithm. 
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28.  MIELE,  A.,  Gradient  Methods  in  Optimal  Control  Theory,  Optimization 
and  Design,  Edited  by  M.  Avriel , M.  J.  Rijckaert,  and  D.  J.  Wilde, 
Prentice-Hall,  Englewood  Cliffs,  New  Jersey,  1973. 

Abstract.  In  this  paper,  recent  work  performed  at  Rice  University  on 
gradient  methods  in  optimal  control  theory  is  presented  from  a unified 
point  of  view.  The  problem  considered  is  that  of  minimizing  a functional 
I with  respect  to  the  state  x(6)  and  the  control  u(e)  which  satisfy  a 
vector  differential  constraint,  a vector  initial  condition,  and  a vector 
final  condition.  The  algorithms  presented  are  two:  (i)  the  sequential 
gradient-restoration  algorithm  and  (ii)  the  combined  gradient-restoration 
algorithm. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  gradient 
algorithm,  restoration  algorithm,  sequential  gradient-restoration  algorithm, 
combined  gradient-restoration  algorithm. 
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29.  HUANG,  H.  Y.,  and  NAQVI,  S.,  Extremization  of  Terminally  Constrained 

Control  Problems,  Journal  of  the  Astronautical  Sciences,  Vol.20,  No. 4,  1973. 

Abstract.  In  this  paper,  the  problem  of  extremizing  a functional  I in- 
volving the  state  x(t),  the  control  u(t),  and  the  parameter  it  is  con- 
sidered. The  admissible  state,  control,  and  parameter  are  required  to 
satisfy  a vector  differential  constraint,  a vector  initial  constraint,  and 
a vector  terminal  constraint. 

This  problem  is  transformed  into  a mathematically  simpler,  uncon- 
strained problem  of  minimizing  a new  functional,  the  performance  index  R.  In 
turn,  R involves  the  state,  the  control,  the  parameter,  the  Lagrange  multi- 
plier X ( t ) associated  with  the  vector  differential  constraint,  and  the 
Lagrange  multiplier  u associated  with  the  vector  terminal  constraint.  To 
obtain  the  minimum  R = 0 of  the  performance  index,  a gradient  algorithm  is 
first  developed.  In  order  to  achieve  simplicity  in  programming  and  to  by- 
pass the  explicit  use  of  second-order  derivatives,  the  gradient  algorithm 
is  modified  so  that  it  becomes  a pure,  first-order  method.  For  better  con- 
vergence property,  a conjugate-gradient  algorithm  is  also  developed. 

Concerning  the  determination  of  the  stepsize  in  these  algorithms, 
a one-cycle  cubic  interpolation  scheme  is  presented.  Again,  the  explicit 
use  of  second-order  derivatives  is  avoided  here. 

Both  the  gradient  algorithm  and  the  conjugate-gradient  algorithm  are 
tested  through  several  numerical  examples.  The  results  show  that,  while 
the  gradient  algorithm  is  relatively  slow  in  convergence,  the  conjugate- 
gradient  algorithm  displays  better  convergence  characteristics. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  terminal 
constraints,  performance  index,  gradient  algorithm,  conjugate-gradient 
algorithm. 
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30.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.t  Multipoint  Approach  to  the 
Two-Point  Boundary-Value  Problem,  Journal  of  Mathematical  Analysis  and 
Applications,  Vol.44,  No. 3,  1973. 

Abstract.  This  paper  treats  nonlinear,  two-point  boundary  value  problems 
of  the  form  x - <}>(x,t)  = 0,  in  which  the  Jacobian  matrix  4>x ( x , t ) is 
characterized  by  large  positive  eigenvalues.  The  resulting  numerical  dif- 
ficulties are  reduced  by  treating  the  two-point  boundary  value  problem  as 
a multipoint  boundary  value  problem.  A totally  finite-difference  approach 
is  employed,  thus  bypassing  the  integration  of  the  nonlinear  equations, 
which  characterizes  shooting  methods. 

The  approach  employed  consists  of  extending  to  multipoint  boundary 
value  problems  the  modified  quasilinearization  method  developed  by  Miele 
and  Iyer  for  two-point  boundary  value  problems.  Basic  to  the  method  is 
the  consideration  of  the  performance  index  P,  which  measures  the  cumulative 
error  in  the  differential  equations,  the  boundary  conditions,  and  the 
Interface  conditions. 

A modified  quasilinearization  algorithm  is  generated  by  requiring 
the  first  variation  of  the  performance  index  6P  to  be  negative.  This 
algorithm  differs  from  the  ordinary  quasilinearization  algorithm  because 
of  the  inclusion  of  the  scaling  factor  or  stepsize  a in  the  system  of 
variations.  The  main  property  of  the  modified  quasilinearization  algorithm 
is  the  descent  property:  if  the  stepsize  a is  sufficiently  small,  the  re- 
duction In  P is  guaranteed.  Convergence  to  the  desired  solution  is 
achieved  when  the  inequality  P < c is  met,  where  e is  a small,  preselected 
number. 

The  variations  per  unit  stepsize  Ax(t)/a  * A(t)  are  governed  by  a 
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system  of  mn  nonhomogeneous , linear  differential  equations  subjected  to  p 
initial  conditions,  q final  conditions,  and  (m-l)n  interface  conditions, 
with  p + q = n,  where  n is  the  dimension  of  the  vector  x and  m is  the  number 
of  subintervals.  Therefore,  the  total  number  of  boundary  conditions  and 
interface  conditions  is  mn.  The  above  system  is  solved  employing  the 
method  of  particular  solutions:  m(n  +1)  particular  solutions  are  combined 
linearly,  and  the  coefficients  of  the  combination  are  determined  so  that 
the  linear  system  is  satisfied. 

Two  numerical  examples  are  presented,  one  dealing  with  a linear  system 
and  one  dealing  with  a nonlinear  system.  The  examples  illustrate  the  ef- 
fectiveness as  well  as  the  rapidity  of  convergence  of  the  present  method. 

Key  Words.  Differential  equations,  stiff  differential  equations,  numerical 
methods,  computing  methods,  eigenvalues,  two-point  boundary-value  problem, 
multipoint  boundary-value  problem,  modified  quasi  1 inearization  algorithm. 
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31.  HENNIG,  G.  R.,  and  MIELE,  A.,  Sequential  Gradient-Restoration  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State,  Journal  of  Optimization 
Theory  and  Applications,  Vol.12,  No.l,  1973. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a 
state  inequality  constraint,  and  terminal  constraints.  The  problem  is  to 
find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so  that  the 
functional  is  minimized,  while  the  constraints  are  satisfied  to  a pre- 
determined accuracy. 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles,  each 
composed  of  a gradient  phase  and  a restoration  phase.  The  gradient  phase 
involves  a single  iteration  and  is  designed  to  decrease  the  functional, 
while  the  constraints  are  satisfied  to  first  order.  The  restoration  phase 
involves  one  or  several  iterations  and  is  designed  to  restore  the  constraints 
to  a predetermined  accuracy,  while  the  norm  of  the  variations  of  the  con- 
trol and  the  parameter  is  minimized.  The  principal  property  of  the  al- 
gorithm is  that  it  produces  a sequence  of  feasible  suboptimal  solutions: 
the  functions  x(t),  u(t),  tt  obtained  at  the  end  of  each  cycle  satisfy  the 
constraints  to  a predetermined  accuracy.  Therefore,  the  functionals  of 
any  two  elements  of  the  sequence  are  comparable. 

Here,  the  state  inequality  constraint  is  handled  in  a direct  manner. 

A predetermined  number  and  sequence  of  subarcs  is  assumed  and,  for  the  time 
interval  for  which  the  trajectory  of  the  system  lies  on  the  state  boundary, 
the  control  is  determined  so  that  the  state  boundary  is  satisfied.  The 
state  boundary  and  the  entrance  conditions  are  assumed  to  be  linear  in  x 
and  tt  , and  the  sequential  gradient-restoration  algorithm  is  constructed 
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To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  0 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that  each 
of  the  subarcs  composing  the  extremal  arc  has  a normalized  time  length 
At  = 1.  In  this  way,  variable-time  corner  conditions  and  variable-time 
terminal  conditions  are  transformed  into  fixed-time  corner  conditions  and 
fixed-time  terminal  conditions.  The  actual  times  0lt  02,  t at  which  (i)  the 
state  boundary  is  entered,  (ii)  the  state  boundary  is  exited,  and  (iii)  the 
terminal  boundary  is  reached  are  regarded  to  be  components  of  the  parameter 
ii  being  optimized. 

The  numerical  examples  illustrating  the  theory  demonstrate  the  feasi- 
bility as  well  as  the  rapidity  of  convergence  of  the  technique  developed 
In  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  sequential  gradient-restoration  algorithm, 
anchoring  conditions. 
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32.  MIELE,  A.,  WELL,  K.  H.,  and  TIETZE,  J.  L.,  Modified  Quasi! inearization 
Algorithm  for  Optimal  Control  Problems  with  Bounded  State,  Journal  of 
Optimization  Theory  and  Applications,  Vol.12,  No. 3,  1973. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a 
state  inequality  constraint,  and  terminal  constraints.  The  problem  is  to 
find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so  that  the 
functional  is  minimized,  while  the  constraints  are  satisfied  to  a pre- 
determined accuracy. 

A modified  quasi  1 inearization  algorithm  is  developed.  Its  main 
property  is  the  descent  property  in  the  performance  index  R,  the  cumulative 
error  in  the  constraints  and  the  optimality  conditions.  Modified  quasi- 
linearization differs  from  ordinary  quasilinearization  because  of  the  in- 
clusion of  the  scaling  factor  or  stepsize  a in  the  system  of  variations. 
The  stepsize  is  determined  by  a one-dimensional  search  on  the  performance 
index  R.  Since  the  first  variation  6R  is  negative,  the  decrease  in  R is 
guaranteed  if  a is  sufficiently  small.  Convergence  to  the  solution  is 
achieved  when  R becomes  smaller  than  some  preselected  value. 

Here,  the  state  inequality  constraint  is  handled  in  a direct  manner. 

A predetermined  number  and  seqMence  of  subarcs  is  assumed  and,  for  the 
time  Interval  for  which  the  trajectory  of  the  system  lies  on  the  state 
boundary,  the  control  is  determined  so  that  the  state  boundary  is  satisfied. 
The  state  boundary  and  the  entrance  conditions  are  assumed  to  be  linear  in 
x and  n,  and  the  modified  quasilinearization  algorithm  is  constructed  in 
such  a way  that  the  state  Inequality  constraint  Is  satisfied  at  each  itera- 
tion and  along  all  of  the  subarcs  composing  the  trajectory. 
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At  first  glance,  the  assumed  linearity  of  the  state  boundary  and 
the  entrance  conditions  appears  to  be  a limitation  to  the  theory.  Ac- 
tually, this  is  not  the  case.  The  reason  is  that  every  constrained  mini- 
mization problem  can  be  brought  to  the  present  form  through  the  intro- 
duction of  additional  state  variables. 

In  order  to  start  the  algorithm,  some  nominal  functions  x(t),  u(t), 

7t  and  nominal  multipliers  A(t),  p(t),  o,u  must  be  chosen.  In  a real 
problem,  the  selection  of  the  nominal  functions  can  be  made  on  the  basis 
of  physical  considerations.  Concerning  the  nominal  multipliers,  no  useful 
guidelines  have  been  available  thus  far.  In  this  paper,  an  auxiliary 
minimization  algorithm  for  selecting  the  multipliers  optimally  is  pre- 
sented: the  performance  index  R is  minimized  with  respect  to  X(t),  p(t), 
o , p . Since  the  functional  R is  quadratical ly  dependent  on  the  multi- 
pliers, the  resulting  variational  problem  is  governed  by  optimality  con- 
ditions which  are  linear  and,  therefore,  can  be  solved  without  difficulty. 

The  numerical  examples  illustrating  the  theory  demonstrate  the 
feasibility  as  well  as  the  rapidity  of  convergence  of  the  technique  de- 
veloped in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  modified  quasilinearization  algorithm, 
anchoring  conditions. 
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33.  HUANG,  H.  Y.,  and  ESTERLE,  A.,  Anchoring  Conditions  for  the  Sequential 

Gradient-Restoration  Algorithm  and  the  Modified  Quasi  1 inearization  Algorithm 
for  Optimal  Control  Problems  with  Bounded  State,  Journal  of  Optimization 
Theory  and  Applications,  Vol.12,  No. 5,  1973. 

Abstract.  In  Refs. 31-32,  the  sequential  gradient-restoration  algorithm  and 
the  modified  quasilinearization  algorithm  were  developed  for  optimal  con- 
trol problems  with  bounded  state.  These  algorithms  have  a basic  property: 
for  a subarc  lying  on  the  state  boundary,  the  state  boundary  equations  are 
satisfied  at  every  iteration,  if  they  are  satisfied  at  the  beginning  of  the 
computational  process.  Thus,  the  subarc  remains  anchored  on  the  state 
boundary.  In  this  paper,  the  anchoring  conditions  employed  in  Refs. 31-32 
are  derived. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  transformation  techniques,  sequential  gradient-restoration  algorithm, 
modified  quasilinearization  algorithm,  anchoring  conditions. 
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34.  MIELE,  A.,  DAMOULAKIS,  J.  N.,  CLOUTIER,  J.  R.,  and  TIETZE,  J.  L.,  Se- 
quential Gradient-Restoration  Algorithm  for  Optimal  Control  Problems 
with  Nondifferential  Constraints,  Journal  of  Optimization  Theory  and 
Appl ications,  Vol.13,  No. 2,  1974. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  non- 
differential constraints,  and  terminal  constraints.  The  problem  is  to  find 
the  state  x(t),  the  control  u(t),  and  the  parameter  n so  that  the  functional 
is  minimized,  while  the  constraints  are  satisfied  to  a predetermined  ac- 
curacy. 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles,  each 
composed  of  a gradient  phase  and  a restoration  phase.  The  gradient  phase 
involves  a single  iteration  and  is  designed  to  decrease  the  functional, 
while  the  constraints  are  satisfied  to  first  order.  The  restoration 
phase  involves  one  or  several  iterations  and  is  designed  to  restore  the 
constraints  to  a predetermined  accuracy,  while  the  norm  of  the  variations 
of  the  control  and  the  parameter  is  minimized. 

The  principal  property  of  the  algorithm  is  that  it  produces  a se- 
quence of  feasible  suboptimal  solutions:  the  functions  x(t),  u(t),  tt 
obtained  at  the  end  of  each  cycle  satisfy  the  constraints  to  a predeter- 
mined accuracy.  Therefore,  the  functionals  of  any  two  elements  of  the 
sequence  are  compilable. 

The  stepsize  of  the  gradient  phase  is  determined  by  a one-dimen- 
sional search  on  the  augmented  functional  J,  and  the  stepsize  of  the  res- 
toration phase  by  a one-dimensional  search  on  the  constraint  error  P.  If 
oig  is  the  gradient  stepsize  and  «r  is  the  restoration  stepsize,  the  gradient 
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corrections  are  of  0(a)  and  the  restoration  corrections  are  of  0(a  a 2). 

9 r g 

Therefore,  for  ag  sufficiently  small,  the  restoration  phase  preserves  the 

A 

descent  property  of  the  gradient  phase:  the  functional  I at  the  end  of 
any  complete  gradient-restoration  cycle  is  smaller  than  the  functional  I 
at  the  beginning  of  the  cycle. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  9 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that  the 
extremal  arc  has  a normalized  time  length  At  = 1 . In  this  way,  variable- 
time terminal  conditions  are  transformed  into  fixed-time  terminal  conditions. 
The  actual  time  t at  which  the  terminal  boundary  is  reached  is  regarded  to 
be  a component  of  the  parameter  tt  being  optimized. 

The  present  general  formulation  differs  from  that  of  Miele,  Pritchard, 
and  Damoulakis  because  of  the  inclusion  of  the  nondifferential  constraints 
to  be  satisfied  everywhere  over  the  interval  0 £ t £ 1.  Its  importance 
lies  in  that  (i)  many  optimization  problems  arise  directly  in  the  form  con- 
sidered here,  (ii)  problems  involving  state  equality  constraints  can  be  re- 
duced to  the  present  scheme  through  suitable  transformations,  and  (iii)  prob- 
lems involving  inequality  constraints  can  be  reduced  to  the  present  scheme 
through  suitable  transformations.  The  latter  statement  applies,  for  in- 
stance, to  the  following  situations:  (a)  problems  with  bounded  control, 

(b)  problems  with  bounded  state,  (c)  problems  with  bounded  time  rate  of 
change  of  the  state,  and  (d)  problems  where  some  bound  is  imposed  on  an  ar- 
bitrarily prescribed  function  of  the  parameter,  the  control,  the  state, 
and  the  time  rate  of  change  of  the  state. 

Numerical  examples  are  presented  for  both  the  fixed-final -time  case 
and  the  free-final-time  case.  These  examples  demonstrate  the  feasibility 


| 
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as  well  as  the  rapidity  of  convergence  of  the  technique  developed  in  this 
paper. 


Key  Words. 

differential 

restoration 


Optimal  control,  numerical  methods,  computing  methods,  non- 
constraints, transformation  techniques,  sequential  gradient 
algorithm. 
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35.  MIELE,  A.,  MANGIAVACCHI , A.,  and  AGGARWAL,  A.  K.,  Modified  Quasi  1 ineariza- 
tion  Algorithm  for  Optimal  Control  Problems  with  Nondifferential  Constraints, 
Journal  of  Optimization  Theory  and  Applications,  Vol.14,  No.  5,  1974. 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a fuctional  I subject  to  differential  constraints,  non- 
differential constraints,  and  terminal  constraints.  The  problem  is  to  find 
the  state  x(t),  the  control  u(t),  and  the  parameter  n so  that  the  functional 
is  minimized,  while  the  constraints  are  satisfied  to  a predetermined  accuracy. 

A modified  quasilinearization  algorithm  is  developed.  Its  main  property 
is  the  descent  property  in  the  performance  index  R,  the  cumulative  error  in 
the  constraints  and  the  optimality  conditions.  Modified  quasilinearization 
differs  from  ordinary  quasi  1 inearization  because  of  the  inclusion  of  the 
scaling  factor  or  stepsize  a in  the  system  of  variations.  The  stepsize  is 
determined  by  a one-dimensional  search  on  the  performance  index  R.  Since 
the  first  variation  6R  is  negative,  the  decrease  in  R is  guaranteed  if  a 
is  sufficiently  small.  Convergence  to  the  solution  is  achieved  when  R be- 
comes smaller  than  some  preselected  value. 

In  order  to  start  the  algorithm,  some  nominal  functions  x(t),  u(t), 
tv  and  nominal  multipliers  A ( t ) , p(t),  u must  be  chosen.  In  a real  problem, 
the  selection  of  the  nominal  functions  can  be  made  on  the  basis  of  physical 
considerations.  Concerning  the  nominal  multipliers,  no  useful  guidelines 
have  been  available  thus  far.  In  this  paper,  an  auxiliary  minimization  al- 
gorithm for  selecting  the  multipliers  optimally  is  presented:  the  perfor- 
mance index  R is  minimized  with  respect  to  A(t),  p(t),  u . Since  the 
functional  R is  quadratical ly  dependent  on  the  multipliers,  the  resulting 
variational  problem  is  governed  by  optimality  conditions  which  are  linear 


and,  therefore,  can  be  solved  without  difficulty. 

To  facilitate  the  numerical  solution  on  digital  computers,  the 
actual  time  6 is  replaced  by  the  normalized  time  t,  defined  in  such  a 
way  that  the  extremal  arc  has  a normalized  time  length  At  = 1 . In  this 
way,  variable-time  terminal  conditions  are  transformed  into  fixed-time 
terminal  conditions.  The  actual  time  t at  which  the  terminal  boundary  is 
reached  is  regarded  to  be  a component  of  the  parameter  tt  being  optimized. 

The  present  general  formulation  differs  from  that  contained  in  previous 
work  by  Miele,  Iyer,  and  Well  because  of  che  inclusion  of  the  nondifferential 
constraints  to  be  satisfied  everywhere  over  the  interval  0 < t < 1.  Its  im- 
portance  lies  in  that  (i)  many  optimization  problems  arise  directly  in  the 
form  considered  here,  ( i i ) there  are  problems  involving  state  equality  con- 
straints which  can  be  reduced  to  the  present  scheme  through  suitable  trans- 
formations, and  (iii)  there  are  some  problems  involving  inequality  constraints 
which  can  be  reduced  to  the  present  scheme  through  the  introduction  of  auxi- 
1 iary  variables. 

Numerical  examples  are  presented  for  the  free-final -time  case.  These 
examples  demonstrate  the  feasibility  as  well  as  the  rapidity  of  convergence 
of  the  technique  developed  in  this  paper. 

Key  Words.  Optimal  control , numerical  methods,  computing  methods,  nondif- 
ferential constraints,  transformation  techniques,  modified  ouasil ineariza- 
tion  algorithm. 
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36.  MIEIE,  A.,  AGGARWAL,  A.  K. , and  TIETZE,  J.  L.,  Solution  of  Two-Point 
Boundary-Value  Problems  with  Jacobian  Matrix  Characterized  by  Large 
Positive  Eigenvalues,  Journal  of  Computational  Physics,  Vol.15,  No. 2,  1974. 

Abstract.  This  paper  treats  the  nonlinear,  two-point  boundary-value  problem 
formulated  by  Troesch  and  studied  by  Roberts  and  Shipman.  Computationally 
speaking,  this  is  a difficult  problem,  owing  to  the  fact  that  the  Jacobian 
matrix  is  characterized  by  large  positive  eigenvalues.  The  resulting  dif- 
ficulties are  reduced  by  treating  the  two-point  boundary -value  problem  as 
a multipoint  boundary-value  problem.  The  modified  quasi  1 inearization  al- 
gorithm of  Ref.  30  is  employed.  This  approach  bypasses  the  integra- 
tion of  the  nonlinear  equations,  which  characterizes  shooting  methods. 
Computational  results  are  also  presented  for  another  difficult  nonlinear, 
two-point  boundary-value  problem,  namely,  the  problem  formulated  by  Holt. 

Key  Words.  Troesch's  problem.  Holt’s  problem,  differential  equations, 
stiff  differential  equations,  numerical  methods,  computing  methods, 
eigenvalues,  two-point  boundary- value  problem,  multipoint  boundary-value 
problem,  modified  quasilinearization  algorithm. 
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37.  MIELE,  A.,  TIETZE,  J.  L.,  and  LEVY,  A.  V.,  Comparison  of  Several  Gradient 
Algorithms  for  Mathematical  Programming  Problems,  Omaggio  a Carlo  Ferrari, 

Edited  by  G.  Jarre,  Libreria  Editrice  Universitaria  Levrotto  e Bella, 

Torino,  Italy,  1974. 

Abstract.  In  this  paper,  the  numerical  solution  of  the  basic  problem  of 
mathematical  programming  is  considered.  This  is  the  problem  of  minimizing 
a function  f(x)  subject  to  a constraint  4> ( x ) = 0.  Here,  f is  a scalar,  x 
an  n-vector,  and  $ a q-vector,  with  q < n. 

Six  variations  of  the  sequential  gradient-restoration  algorithm  and 
the  combined  gradient-restoration  algorithm  are  considered,  and  their 
relative  efficiency  (in  terms  of  number  of  iterations  for  convergence)  is 
evaluated.  The  variations  being  considered  are  as  follows: 

(i)  SGRA-CR,  sequential  gradient-restoration  algorithm,  complete  restoration, 

(ii)  SGRA-IR,  sequential  gradient-restoration  algorithm,  incomplete  restoration, 

(iii)  SGRA-OR,  sequential  gradient-restoration  algorithm,  optional  restoration, 

(iv)  CGRA-NR,  combined  gradient-restoration  algorithm,  no  restoration, 

(v)  CGRA-AR,  combined  gradient-restoration  algorithm,  alternate  restoration, 

(vi)  CGRA-OR,  combined  gradient-restoration  algorithm,  optional  restoration. 

Evaluation  of  these  algorithms  is  accomplished  through  eight  numerical 
examples.  The  first  two  examples  pertain  to  quadratic  functions  subject  to 
linear  constraints.  The  remaining  examples  pertain  to  nonquadratic  functions 
subject  to  nonlinear  constraints.  The  results  indicate  that  (a)  the  inclusion 
of  a restoration  phase  is  necessary  for  rapid  convergence  and  (b)  the  al- 
gorithms with  alternate  restoration  or  optional  restoration  are  the  most 
efficient  among  those  considered  here. 

Key  Words.  Mathematical  programming,  numerical  methods,  computing  methods, 
gradient  algorithm,  restoration  algorithm,  gradient-restoration  algorithm. 
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38.  HE  I DEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Restora- 
tion Algorithm  for  Optimal  Control  Problems,  Part  1,  Theory,  Journal  of 
Optimization  Theory  and  Applications,  Vol .15,  No. 2,  1975. 

Abstract.  This  paper  considers  the  problem  of  minimizing  a functional  I 
which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  . 
Here,  I is  a scalar,  x and  n-vector,  u an  m-vector,  and  tt  a p-vector.  At 
the  initial  point,  the  state  is  prescribed.  At  the  final  point,  the  state 
and  the  parameter  are  required  to  satisfy  q scalar  relations.  Along  the 
interval  of  integration,  the  state,  the  control,  and  the  parameter  are 
required  to  satisfy  n scalar  differential  equations. 

First,  the  case  of  a quadratic  functional  subject  to  linear  con- 
straints is  considered,  and  a conjugate-gradient  algorithm  is  derived. 
Nominal  functions  x(t),  u(t),  tt  satisfying  all  the  differential  equations 
and  boundary  conditions  are  assumed.  Variations  Ax(t),  Au(t),  Att  are  de- 
termined so  that  the  value  of  the  functional  is  decreased.  These  variations 
are  obtained  by  minimizing  the  first-order  change  of  the  functional  subject 
to  the  linearized  differential  equations,  the  linearized  boundary  condi- 
tions, and  a quadratic  constraint  on  the  variations  of  the  control  and  the 
parameter. 

Next,  the  more  general  case  of  a nonqujdratic  functional  subject  to 
nonlinear  constraints  is  considered.  The  algorithm  derived  for  the  linear- 
quadratic  case  is  employed  with  one  modification:  a restoration  phase  is  in- 
serted between  any  two  successive  conjugate-gradient  phases. 

In  the  restoration  phase,  variations  Ax(t),  Au(t),  Att  are  determined 
by  requiring  the  least-square  change  of  the  control  and  the  parameter  sub- 
ject to  the  linearized  differential  equations  and  the  linearized  boundary 
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conditions.  Thus,  a sequential  conjugate-gradient-restoration  algorithm 
is  constructed  in  such  a way  that  the  differential  equations  and  the 
boundary  conditions  are  satisfied  at  the  end  of  each  complete  conjugate 
gradient-restoration  cycle. 

Several  numerical  examples  illustrating  the  theory  of  this  paper  are 
given  in  Part  2 (see  Ref. 39).  These  examples  demonstrate  the  feasibility 
as  well  as  the  rapidity  of  convergence  of  the  technique  developed  in  this  paper. 
Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  sequential 
conjugate  gradient-restoration  algorithm. 
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39.  HEIDEMAN,  J.  C.,  and  LEVY,  A.  V.,  Sequential  Conjugate  Gradient-Restoration 
Algorithm  for  Optimal  Control  Problems,  Part  2,  Examples,  Journal  of  Optimiza- 
tion Theory  and  Applications,  Vol .15,  No. 2,  1975. 

Abstract.  In  Ref. 38,  Heideman  and  Levy  developed  the  sequential  conjugate 
gradient-restoration  algorithm  for  minimizing  a functional  subject  to  dif- 
ferential constraints  and  terminal  constraints.  In  this  paper,  several 
numerical  examples  are  presented,  some  pertaining  to  a quadratic  functional 
subject  to  linear  constraints  and  some  pertaining  to  a nonquadratic  func- 
tional subject  to  nonlinear  constraints.  These  examples  demonstrate  the 
feasibility  as  well  as  the  rapid  convergence  characteristics  of  the  sequential 
conjugate  gradient-restoration  algorithm  of  Ref. 38. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  sequential 
conjugate  gradient-restoration  algorithm. 
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40.  MIELE,  A.,  TIETZE,  J.  L.,  and  CLOUTIER,  J.R.,  A Hybrid  Approach  to  Optimal 
Control  Problems  with  Bounded  State,  Computer  and  Mathematics  with  Applica- 
tions, Vol.l,  No. 2,  1975.  -j 

Abstract.  This  paper  considers  the  numerical  solution  of  optimal  control 
problems  involving  a functional  I subject  to  differential  constraints,  a i 

state  inequality  constraint,  and  terminal  constraints.  The  problem  is  to  . 

find  the  state  x(t),  the  control  u(t),  and  the  parameter  tt  so  that  the  * 

functional  is  minimized,  while  the  constraints  are  satisfied  to  a prede-  | 

termined  accuracy. 

The  approach  taken  is  a sequence  of  two-phase  processes  or  cycles,  | 

each  composed  of  a gradient  phase  and  a restoration  phase.  The  gradient 
phase  involves  a single  iteration  and  is  designed  to  decrease  the  functional,  $ 

while  the  constraints  are  satisfied  to  first  order.  The  restoration  phase  ■ 

involves  one  or  several  iterations  and  is  designed  to  restore  the  con- 
straints to  a predetermined  accuracy,  while  the  norm  of  the  variations  of  § 

the  control  and  the  parameter  is  minimized.  The  principal  property  of  the 
algorithm  is  that  it  produces  a sequence  of  feasible  suboptimal  solutions:  * 

the  functions  x(t),  u(t),  it  obtained  at  the  end  of  each  cycle  satisfy  the  m 

constraints  to  a predetermined  accuracy.  Therefore,  the  functionals  of  any 
two  elements  of  the  sequence  are  comparable.  | 

The  technique  employed  is  of  the  hybrid  type,  in  an  attempt  to  com- 
bine some  of  the  best  features  of  both  direct  and  indirect  approaches.  I 

While  a predetermined  number  and  sequence  of  subarcs  are  assumed  (a  feature  B 

of  direct  methods),  enforcement  of  the  state  inequality  constraint  is  ob-  * 

tained  through  a Valentine-type  representation  (a  feature  of  indirect  methods).  B 
By  properly  choosing  the  analytical  form  of  certain  nondifferential 
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constraints  to  be  satisfied  by  the  augmented  control  along  each  subarc 
composing  the  extremal  arc  (these  nondifferential  constraints  are  arrived 
at  through  the  Valentine-type  transformation),  one  ensures  satisfaction  of 
the  state  inequality  constraint  everywhere.  Specifically,  strict  inequality 
is  enforced  for  the  subarcs  internal  to  the  state  boundary  and  strict  equality 
is  enforced  for  the  subarcs  lying  on  the  state  boundary. 

To  facilitate  the  numerical  solution  on  digital  computers,  the  actual 
time  9 is  replaced  by  the  normalized  time  t,  defined  in  such  a way  that  each 
subarc  composing  the  extremal  arc  has  a normalized  time  length  At  = 1 . In 
this  way,  variable-time  corner  conditions  and  variable-time  terminal  con- 
ditions are  transformed  into  fixed-time  corner  conditions  and  fixed-time 
terminal  conditions.  The  actual  times  6i,  62,  t at  which  (i)  the  state 
boundary  is  entered,  (ii)  the  state  boundary  is  exited,  and  (iii)  the  terminal 
manifold  is  reached  are  regarded  to  be  components  of  the  parameter  tt  being 
optimized. 

The  numerical  examples  illustrating  the  theory  demonstrate  the  feasi- 
bility as  well  as  the  rapidity  of  convergence  of  the  technique  developed  in 
this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  nondifferential  constraints,  hybrid  approach,  sequential  gradient- 
restoration  algorithm. 
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41.  MIELE,  A.,  and  CLOUTIER,  J.  R.,  New  Transformation  Technique  for  Optimal 
Control  Problems  with  Bounded  State,  Part  1,  Theory,  Aerotecnica,  Missili, 
e Spazio,  Vol.54,  No. 2,  1975. 

Abstract.  In  this  paper,  the  numerical  solution  of  optimal  contrc1  problems 
involving  a state  inequality  constraint  of  the  form  L(x,0)  > 0 is  considered. 
The  approach  employed  is  of  the  hybrid  type,  in  an  attempt  to  combine  some 
of  the  best  features  of  the  direct  approach  and  the  indirect  approach.  While 
a predetermined  number  and  sequence  of  subarcs  are  assumed  (a  feature  of 
direct  methods),  enforcement  of  the  state  inequality  constraint  is  obtained 
through  a Valentine-type  representation  (a  feature  of  indirect  methods). 

A new  transformation  technique  is  developed  by  applying  the  Valentine- 
type  representation  to  the  kth  derivative  of  the  function  L(x,0),  assumed 
to  have  a constant  sign  in  each  of  the  subarcs  composing  the  extremal  arc. 

By  properly  choosing  the  analytical  form  of  certain  nondifferential  con- 
straints to  be  satisfied  by  the  augmented  control  along  each  subarc  composing 
the  extremal  arc  (these  nondifferential  constraints  are  arrived  at  through  the 
Valentine-type  transformation),  one  ensures  satisfaction  of  the  state  in- 
equality constraint  everywhere.  Specifically,  strict  inequality  is  enforced 
for  the  subarcs  internal  to  the  state  boundary  and  strict  equality  is  en- 
forced for  the  subarcs  lying  on  the  state  boundary. 

Since  the  Valentine-type  representation  is  applied  to  the  kth  deriva- 
tive of  the  function  L(x,0),  rather  than  to  the  function  itself,  problems 
witn  bounded  state  can  be  treated  without  augmenting  the  dimension  of  the 
state  vector.  This  concept  is  important  computationally,  in  that  the  com- 
puting time  per  iteration  Increases  with  the  square  of  the  dimension  of  the 


state  vector. 


The  algorithm  developed  belongs  to  the  class  of  sequential  gradient- 
restoration  algorithms.  The  approach  taken  is  a sequence  of  two-phase 
processes  or  cycles,  each  composed  of  a gradient  phase  and  a restoration 
phase.  The  gradient  phase  involves  a single  iteration  and  is  designed  to 
decrease  the  functional,  while  the  constraints  are  satisfied  to  first  order. 
The  restoration  phase  involves  one  or  several  iterations  and  is  designed  to 
restore  the  constraints  to  a predetermined  accuracy,  while  the  norm  of  the 
variations  of  the  control  and  the  parameter  is  minimized. 

The  principal  property  of  the  algorithm  is  that  it  produces  a sequence 
of  feasible  suboptimal  solutions:  the  functions  x(t),  u(t),  n obtained  at 
the  end  of  each  cycle  satisfy  the  constraints  to  a predetermined  accuracy. 
Therefore,  the  functionals  of  any  two  elements  of  the  sequence  are  comparabl 

Numerical  examples  illustrating  the  theory  are  given  in  Part  2 (see 
Ref. 42)  and  demonstrate  the  feasibility  as  well  as  the  rapidity  of  con- 
vergence of  the  technique  developed  in  this  paper. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  hybrid  approach,  transformation  techniques,  sequential  gradient- 
restoration  algorithm. 
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42.  MIELE,  A.,  and  CLOUTIER,  J.  R.,  New  Transformation  Technique  for  Optimal 

Control  Problems  with  Bounded  State,  Part  2,  Examples,  Aerotecni ca , Mi ss i 1 i , 
e Spazio,  Vol.54,  No. 3,  1975. 

Abstract.  In  Ref. 41,  Miele  and  Cloutier  developed  a new  transformation 
technique  for  optimal  control  problems  with  bounded  state.  This  transforma- 
tion technique  was  employed  in  conjunction  with  the  sequential  gradient- 
restoration  algorithm.  In  this  paper,  three  numerical  examples  are  pre- 
sented, one  pertaining  to  the  fixed-final -time  case  and  two  pertaining  to  tht 
free-final-time  case.  The  numerical  results  show  the  rapid  convergence 
characteristics  of  the  algorithm  discussed  in  Ref. 41. 

Key  Words.  Optimal  control,  numerical  methods,  computing  methods,  bounded 
state,  hybrid  approach,  transformation  techniques,  sequential  gradient- 
l restoration  algorithm. 
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43.  MIELE,  A.,  Recent  Advances  in  Gradient  Algorithms  for  Optimal  Control 

Problems , Journal  of  Optimization  Theory  and  Applications,  Vol.17,  Nos. 5/6,  197: 

Abstract.  This  paper  summarizes  recent  advances  in  the  area  of  gradient  al- 
gorithms for  optimal  control  problems,  with  particular  emphasis  on  the  work 
performed  by  the  staff  of  the  Aero-Astronautics  Group  of  Rice  University. 

The  following  basic  problem  is  considered:  minimize  a functional  I 
which  depends  on  the  state  x(t),  the  control  u(t),  and  the  parameter  it  . 

Here,  I is  a scalar,  x an  n-vector,  u an  m-vector,  and  tt  a p-vector.  At  the 
initial  point,  the  state  is  prescribed.  At  the  final  point,  the  state  x and 
the  parameter  tt  are  required  to  satisfy  q scalar  relations.  Along  the  in- 
terval of  integration,  the  state,  the  control,  and  the  parameter  are  re- 
quired to  satisfy  n scalar  differential  equations. 

First,  the  sequential  gradient-restoration  algorithm  and  the  combined 
gradient-restoration  algorithm  are  presented.  The  descent  properties  of 
these  algorithms  are  studied,  and  schemes  to  determine  the  optimum  stepsize 
are  discussed.  Both  of  the  above  algorithms  require  the  solution  of  a 
linear,  two-point  boundary-value  problem  at  each  iteration.  Hence,  a dis- 
cussion of  integration  techniques  is  given. 

Next,  a family  of  gradient-restoration  algorithms  is  introduced.  Not 
only  does  this  family  include  the  previous  two  algorithms  as  particular  cases, 
but  it  allows  one  to  generate  several  additional  algorithms,  namely,  those 
with  alternate  restoration  and  optional  restoration. 

Then,  two  modifications  of  the  sequential  gradient-restoration  al- 
gorithm are  presented  in  an  effort  to  accelerate  terminal  convergence.  In 
•'»  first  modification,  the  quadratic  constraint  imposed  on  the  variations 

control  is  modified  by  the  inclusion  of  a positive-definite  weighting 
j ■ . • matrix  of  the  second  derivatives  of  the  Hamiltonian  with 
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respect  to  the  control).  The  second  modification  is  a conjugate-gradient 
extension  of  the  sequential  gradient-restoration  algorithm. 

Next,  the  addition  of  a nondifferential  constraint,  to  be  satisfied 
everywhere  along  the  interval  of  integration,  is  considered.  In  theory, 
this  seems  to  be  only  a minor  modification  of  the  basic  problem.  In  practice, 
the  change  is  considerable  in  that  it  enlarges  dramatically  the  number  and 
variety  of  problems  of  optimal  control  which  can  be  treated  by  gradient- 
restoration  algorithms.  Indeed,  by  suitable  transformations , almost  every 
known  problem  of  optimal  control  theory  can  be  brought  into  this  scheme. 

This  statement  applies,  for  instance,  to  the  following  situations:  (i)  prob- 
lems with  control  equality  constraints,  (ii)  problems  with  state  equality 
constraints,  (iii)  problems  with  equality  constraints  on  the  time  rate  of 
change  of  the  state,  (iv)  problems  with  control  inequality  constraints, 

(v)  problems  with  state  inequality  constraints,  and  (vi)  problems  with  in- 
equality constraints  on  the  time  rate  of  change  of  the  state. 

Finally,  the  simultaneous  presence  of  nondifferential  constraints  and 
multiple  subarcs  is  considered.  The  possibility  that  the  analytical  form 
of  the  functions  under  consideration  might  change  from  one  subarc  to  another 
is  taken  into  account.  The  resultin,  rormulation  is  particularly  relevant 
to  those  problems  of  optimal  control  involving  bounds  on  the  control  or  the 
state  or  the  time  derivative  of  the  state.  For  these  problems,  one  might 
be  unwilling  to  accept  the  simplistic  view  of  a continuous  extremal  arc. 
Indeed,  one  might  want  to  take  the  more  realistic  view  of  an  extremal  arc 
composed  of  several  subarcs,  some  internal  to  the  boundary  being  considered 
and  some  lying  on  the  boundary. 

The  paper  ends  with  a section  dealing  with  transformation  techniques. 
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This  section  illustrates  several  analytical  devices  by  means  of  which 
a great  number  of  problems  of  optimal  control  can  be  reduced  to  one  of  the 
formulations  presented  here.  In  particular,  the  following  topics  are 
treated:  (i)  time  normalization,  (ii)  free  initial  state,  (iii)  bounded 
control,  and  (iv)  bounded  state. 

Key  Words.  Survey  papers,  gradient  methods,  numerical  methods,  computing 
methods,  calculus  of  variations,  optimal  control,  gradient-restoration 
algorithms,  boundary-value  problems,  bounded  control  problems,  bounded  state 
problems,  nondifferential  constraints. 
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